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ABSTRACT 

j . , This report describes the background, developaent, 

r«j:iidation, and aajor coa^onents of the standardized Assessaent 
Jfitii (SAS) . (The SAS is a aulti- component isystea designed fpr use 
iff. evaluating a wide variety of experiaental and demonstration youth 
nrogxaas initiated the 'louth Employaent and Deaonstration Projects 
>4Ct--^IEDPA— of 1977.) Foilowin^/a brief brief description of the 
tfoxkiigs of the systea, the aajor coaponents of the systea (including 
instruments to aeasuxe paxttcipant characteristics and a psychoaetric 
batter fv designed to assess career decision aaking, awareness, and 
capability; self-image; work attitudes; job search capacity; and 
bccupational sex stereoti^ing) and their rationale are discussed. The 
validation 'Of SAS instruaents' under current deaonstration projects is 
examined^ Outlined next is the application of the aeasuxes, followed 
by an explanation of the basic analysis plan. Appended to thg^xeport. 
are the following SAS instruaents: the Indi^lual Participant ^ 
Profile; the Vocation al Attitude Scale; a series of aeasures to 
assW'job knowledge, job holding skills, job seeking skills^ sex 
stereotypes of adult occupations, and self-esteea; the Hork Relevant 
Attitudes invehtory; a prograa completion survey; and a prograa 
fpllowup surveys instructions for administering the instruaents are 
included* (Related youth knowledge and development reports are 
available separately through EElCr-see note.) (MN) 
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OVERVIEW 



The Youth Eanployment and Demonstration Projects Act .of 1977 
authorized a range of research, evaluation and demonstration 
activities to increase "understanding of the employment prob- 
lems of youth and to help determine the most effective 
policies and programs to address these problems. In the. 
preceding fifteen years, a massive array of research and' dem- 
onstration activity had been undertaken for this same purpose. 
Under the War on Poverty and continuing, under CETA,. there ~had~-~ 
been thousands of innovative projects and tests of alternative 
approaches* While much had been learned from these efforts, 
it wa.?. the Congressional perception that there was no firm 
informational basis for public policy. 

There are several reasons why more had not beisn learned. 
Firsts past demonstrations wisro rarely implen.ented in mul-^ 

. tiple sites with the varying conditions and large sample sizes 
needed to reliably capture the impacts of short-term in-^erven- 
tions or to predict success in alternative settings.^ S cond^ 

. the assessment procedures' varied from one demonstration to the 
next in terms of measures of success, control or comparison 
group selection and the like,. Third, the 'evaluations were too 
frequently limited in scope. Rarely was process' and cost 
information integrated with rigorous statistical impact anal- 
ysis. The projects funded by the Department of Labor put 

perhaps too inuch "emphasis, on economic outcomes and too little 

on the psychbiogical"^and""Kehavioral changes so important in 
understanding the youth , experience* Studies by other agencies 
frequently ignored employment issues. .Fourth, there was no 
system for tracking participants over the long run. Use of 
Social Security data to assess the impacts of youth programs^ 
foundered because of the lack of adequate mechanisms for 
identifying comparison groups for^ program participants and 
controlling for the many individual differences which prove 
important over time. 



In view of the need for developing moxe precise knowledge 
* on the effectiveness and impact of alternative youth program 
approaches, the Youth Employment and Demonstration Pro;jects 
Act (YEDPA), was designed as a limited duration, experimental 
effort to enable the . development of a knowledge base which 
would facilitate the .design of new and improved national 
youth policies and programs. 

YEDPA ^provided the Secretary of Labor with substantial 
discr,etionary flexibility in order to design the needed 
knowledge base ais well as the resources to overcome some 
of the earlier shortcomings. Using tfiese resoiarces and 
flexibility, the Department initiated an array of demonstra- 
tion projects testing alternative approaches\and exploring 
key policy questions. Most of the demonstrations consisted 

sites. Insofar as possible^ random assignment control group 
methodologies were employed in the research designs. Process 
and impact evaluations were built in from the outset for each 
of these demonstrations. 

To realize the full potential of this structured array of 
demons'tratious, it was necessary to develop a" Standardized 
Assessment System so thr^t the findings could be reasonably 
compared and contrasted across projects within and between 
the various demonstrations. The SAS which was developed 
aAd is analyzed in this volxime was geared to: 

(1) Provide a uniform data base across a wide variety 
of programs ; Although the YEDPA' demonstration pro-- 
jects are quite diverse in intents, most gather 
similar inforjmation in^a standardized format and 
report the data on an individual, rather than 
aggr^egate basis. The common data base is essen- 

" tial if genefalTzations" are~to be-~ma-de~about- impact 
across sites and delivery agents, and to differen- 
tiate*the impacts of specific elements in the 
service mix. 

(2) Provfde comprehensive information ; The SAS was 
designed to provide comprehensive information 

, ' about participant characteristics including 

psychomeJ:ric variables to tr^ck iu-progr^m 
changes in attitudes and awarenesses, to 
describe the nature of services delivered and 
the setting, and to report on a range of possible 
- — outcomes in- a cons±.?5tent f ashiiou., 

(3) Further' assess the usefulness of instruments ; 
The SAS consisted of instriaments that had been 
demonstrated to be be th- valid and reliable for 
disadvantaged populations similar to those 
servfed.by YEDPA. It is expected that this 
common assessme^nt battery will undergo some 
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revision as a result of the data to be collected 
' during program evaluation* The detenniriation of 
the measurement properties should thus yield a 
battery of appraxsal and survey instriiments that 
are (a) appropriate for :providing descriptive 
information such as group homs; (b) sufficiently 
sensitive to'itieasxire the change resulting from 
' program ihtervention; and (c) predictive of relevant 
outcomes^ regardless of program interventions or any 
other competing causes for changed in scores oyer 
time. 

(4)^ Address a jzariety of critical questions ^ ^ gfgg^^^ 

" regarding program effectiveness ; IiS1^Mveness"-may 
be' defined as improvement along many work-related 
dimensions^. including, development of wbrld-of-work 
competencies and attitudes, job attainment, job 
retention, and jpb performance* The effectiveness 
of. each program sponisor will be assessed on these 
dimensions by comparing ehrollees who experience 
a particular program approach to a comparable 
(control) group of nohenrollees-, or- to a group of 
enrollees who experience a different program approach. 

(5) Provide a foundation for longer term assessment? of 
impacts ; The SAS provides detailed and standardized 
information about individuals; permitting refined 
statistical analysis necessary for construction of 
control groups as a baseline for long-term tracking • 
The longer the follow-rup, the more important 

. -^that— the--cohor-ts--being--compared-are-~similar-^2md L 

that the interventions be closely defined. The 
data base created"^by SAS can be integrated with 
Social Security records over the long-term to 
determine if there are impacts on future employability 
- •-— — ^ beyond the short-term follow-ups. built into the demo- 
stration designs.— 

Thei formal evaluation paradigm assumes a common goal for all 
prime sponsors; namely, •'to provide a broad range of coordinated 
employment and t3;aihing programs for eligible youth in order , 
to provide effectively for comprehensive employment and training 
services to improve their future employability and to explore , 
and experiment with alternative methods for accomplishing such 
programs.*' \ Regardless of the delivery mode, services help to 
bu?ld job^related sKills and job-related attitudes* The 
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listing below presents the (pre** and post-program) measures 
of specific world-of-work competencies which are relevant 
to the various YEDPA programs. 

In-Progr£un 
Evaluation Measures 



Work-Related Skills (Job-Knowledge Scale) 

(Job-Holding Skill Scale) 
(Job-Seeking Skill Scale) 

Work-Related Attitudes . (Vocational Attitude Scale) 

(Worh-Relevar.t Attitudes Scale) 

- , - . ^(Self-Esteem Scale) . ~ 

- (Sex Stereotypes of Adult Occupations 

Scale] 



The- administration of thes.e pre- and post-program measures to 
enrol lees and comparable non-enrollees, or enrollees in alternative 
programs f providesCa means for estimating short-teann program . 
effectiveness r or impact > in the relevant competency areas* The 
corhprehehsive common data base also permits ^the examination of 
program-related gains of designated subpopulations within, as 
well as across, programs. 

Because such measurement is only a short-term asses sirjtei^'and a 
substitute, or "proxy", for more relevant distal or longer-term 
criteria, additional mandated information will be collected at 
program completion and. also at three and eight month peripds 
following program completion. A program completion survey will 
solicit feedback on the enrollee's perceptions of the program 
as well as his or her self-estimate with respect to var^^ables 
that ^rm the follo wing dime nsions: (a) work motivation, {hy 
social and coimnunity adjustment, tcl 'training Srogi-am adjust- 
ment, and Cdl- vocational planning competency. 

The above areas have been demonstrated empirically to be related 
to post-program on-therjob measures of satisfaction!^ 
and -perf ormauice for disadvantaged youth in work-training programs. 
The short-term indicators of gain (in the case of the standardized 
pre- and post-program measures battery) , and the status assessment 
(as measured by the program^compietion survey instrument and by 
work supervisor and counselor ratings) become relevant and 
important. if they, in turn, predict the more pertinent post-program 
job attainment/ job adjustment/ job earnings experi^^ices* 

Th€ behavioral outcomes following program participatibn are 
rele '^ant to the' goals of YEDPA, and instruments for measurement 
of these criteria have -been demonstrated to be both internally \ 
conisistent and predictive from the earlier short-teriiTi criteria. 
These post-program criterion dimensions consist of : (a) on the job 
succes^s and satisfaction ,> (b) general sodial and Vocational 
adjustment, (c) job-search motivation, (d) job-planning 
competency, and short ra^nge job success t 

* iv - S 



To evaluate fairly the effects of specific program activities 
or curricula on short-term and long-term criteria, both within 
and across programs, it is necessary to^ gather additional 
' Jiformation on various program implementation processes, since 
programs differ in their objectives, budgets, duration of 
/employment and training activities provided and in their cur- 
/ riculum content. Thus, for example, there is little ex^ecta- 
' tioh of finding a positive change in. the perception cf 

occupational sex stereotypes at a site which allocated neither 
time nor resources to this particular goal. Process surveys will 
supoly the information necessary with regard to staffing, modes 
of delivery, s.^3:vice time and biadgets allotted to the various 
service categories. The- statistical analysis will make 
use of such information in attempting to determine whjj^ gains 
or program effects were or were not. observefi; Similarly, a 
fair program evaluation involving measures of job attainment 
and other criteria external to the program, must take into 
consideration relevant external conditions (e..g., tiie avail - 
aoility, in both kind and quality, of nonsubsidized jobs) . 
Indices based on the local la^r market conditions will, 
therefore, be used as both ^exploratory and control variables 
in the various evaluation models. 

Because of the massive array of demonstration projects, it is 
also important that there be some standardized groundrules 
for the timing of the apimcation of measures and follow-ups. 
Likewise, there is. a need for a standardized analytical 
approach-so 'that .finding_s of disparate analyses are compar- 
able." While each demonstration may have "its^ own knowledge 
development objectives and special evaluation components to 
assess these objectives., there are certain analytical approaches 
v;hich are a necessary baseline for all assessments. These 
standardized -analytical approaches jaust be built in from the 
beginning of demonstration projects. 

This volume and its appendices describes the elements of the 
Standardized Assessment System including the impact and pro- 
cess measurement batteries, the standard analytical approaches, 
as well as the procedures for 'application. It analy.es the 
background and accumulating evidence on the validity of these 
elements in this system. It presents the measures themselves 
(Appendix 1) as well as referencing the demonstration pro j acts 
in which they are applied. (Appendix 2) * 

This volume is one of the products ^of the "knowledge develop- 
ment" effort implemented under the mandated cf t,»e Youth Employ- 
ment and Demonstration Projects Act of 1977. The knowledge 
development effort consists of hundreds of separate researcn, 
evaluation and demonstration activities which will result in 
literally thousands of written products. The activities have 
•been structured., from the outset so that each is self-standing 
but also interrelated with a host of other activities. The • 
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framework is presented in A Knowledge Development Plan for 
the. Youth Employment and perotfnsttation Projects Act of 1977 » 
A ICnowledge Development Plan for the Youth Initiatives Fiscal 
1979 and Ccanpleting the Youth Agenda : A Plan for Knowledge 
DevelopitUBnty Dissemination and AppTTcat ion in Fiscal 1980 . 

Information is /available or will be coming available from tlie 
various knowledge, development activities to help resolve an 
almost lijnitiess arra^ issues^ but answers to policy 
questions will usually require integration and synthesis 
from a. number of separate products/ which^ in turn^ will depend 
on knowledge and .availability of these products* A major 
shortcoming of past research^ evaluation and demonstration 
activity has been the f ailxirei^to ^organize and disseminate 
the products adequately to, assure '.the full exploitation of 
the findings. The magnitude and structure bf the youth know- 
ledge development effort puts a premium on organization and 
dissemination. ' ^' 

As part of its knowledge development mandate^ therefore, the 
Office of Youth Programs of tlie Departmfent of Labor- will 
( organize, publish and disseminate the written product^ of 

all major research, evaluation and demonstration activities 
supported directly by or mounted in conjunction with the 
knowledge development v. effort. Some of the same products 
may also be published and disseminated through other channels, 
but they will be included in the structured series of Youth 
Knowledge Development Reports in order to facilitate access 
^nd integration. 

The Youth Knowledge Development Reports , of which this is one, 
are divided into twelve broad categories: 

1. Knowledge Development Framework : The products in ^ 
. this category are*^ concerned with the structure of ' 

knowledge development activities, the assessment 
methodologies which are employed, validation of 
measurement instruments, thfi translation of 
knowledge into policy, and the strategy for * 
^ disseminating findings. 

2 . Research on Youth Employment and Employability Develop ^ 
roent : The products in this category represent analyses 

existing data, presentation of findings from new 
data sources, special studies of dimensions of youth ■ 
labor market problems and policy analyses* 

3* Program Evaluations : The products in this category 
include impact, process and benefit-cost evaluations . 
of youth programs* including the Summer Youth Employment 
Program, Job Corps, the Young Adtilt Conservation Corps, 
Youth Employment and Training. Programs, Youth Community 
Conservation and Improvement Projects, and the Targeted 
Jobs Tax Credit. 
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4. Service and Participant Mix ; The evaluations and 
demonstrations summarizecl \in "this category concern 
the matching of different types of youth with different 
service combinations . This^ involves experiments with 
saork vs. worX plus remediation vs.. stiraight 
remediation as. treatment options . . It also 
Includes .attempts to mix disadvantaged and mpre^ 
affluent participahts, as well ^is youth with older 
workers. ' ^ = ; \ , 

5. Edu^cation and Training Approaches : \The products in 
this category present the findings of\ structured 
expeViments to test the impact and effectiveness of 
various education and vo'cational training, approaches 
including specif iC- education methodologies for the 
disadvar^ged, ' alternative education and advanced 
caree^j'^rainin^.- ' _ ' 

6. .gfe-Emplovment and. Transition. Services : The products . 
in this category present the finding^ of structured 
experiments to test the impact and efle^iveness .of . 
school-to-work transition activities, vobational 
exploration, job-search assistance and other efforts 

to better prepare youth for labor market success. 

7. Youth Work Experience : The products in this -.category • 
address the organization of work activities, their 
output, productive roles for youth and the impacts- 

of varibus Cimployraent approaches. 

8. implementation Issues; .This category includes cross-. 

cutting analyses of the practical lessons concerning 
"how- to-do- it." Issues such as learning curves, 
replication processes and programmatic "batting 
averages" will be addressed under this category, as 
well as .the comparative advantages of alternative ^ 
delivery agents. 

9. Des ign ^nd Organizational Alternatives : The products 
in this categoriL^represent assessments of . demonstrations ot 
alternative programand delivery arrangements such as 
consolidation, yearr-round preparation for summer 
programming, the use of incentives and multi-year 
tracking of ^individuals . 

10. -Special Needs Groups : The products in this category 

present findings on the special problems of and adaptations 
needed for significant segments including minorities, 
young mothers, troubled youth, Ind6chinese refugees 
and the handicaped. 
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' 11 • Innovative Approaches : JThe products in/this category 
. presenFTherojiS^^ activities designed to^ 

explore new apj^ibachesv. "Thfe' subjects covered include 
the Youth' IhciBht^ve^'^Entitlement^^ Projects^ private 

sector initiatives^' tKehatiofta^^ service 
experiment, and energy ^inilTi in weather ization^ • 

lowrhead hydroelectriC/jacmi res^tqration, windpower 
and thfe |^ike. . v- ' ' \ " 

,^12* • Institutional Xinkages : '''';The products in this , category ^ 
* * will include studifes 'cJf ins titifi^pnael varraiigCTiente 

and linkages as well as/ assedsitfent^' of demonstration 
activities to. encourage stfch linkag.es; wi^h/ education, 
~ volunteer groups, dr,ug abuse' agHancies and/.6tKe3:* ; ^ /• 

youth serving agencies. ' ' .7/'."' ^^^^^z 

Mn each of these knowledge development categories"^ there wiir 
be a range of discrete demons t;ration, research" and evaluation- 
activities, focused 6n different policy ^ program and analytical 

• issues. For instance, all" experimental demonstration projects 
have both proqess and^^pact evaluations, frequently* undertaken 
l?y 'different evaluation, agepts. ■ XFinding^ will be published as 
they become avafilable so that thete will usually be a series, 
of reports as" evidence accumulates. To organize these pro- 
ducts, each publicatibn is classified in orie of the twelve 
broad knowledge development"^ categories, described in terms of 
the more specific issue, ■ activity, or cluster of afctivities to* 
which it is addressed, with -an identifier of the" product and 
what it representis relative to other products in the demon- 
stration.. Hence, the multiple products under^ a- knowledge 

' development -activity are closely interrelated and the activ- 
ities in each broad cluster have significant interconnections. 

This voliime on the Standardized Assessment System has impli- 
cations for iTDst of the demonstration projects described in 
the other categories. All the products in the "kno^ledge^ 
development framework^', category ^are closely related. In 
partrxciilar however. The" Knowledge Developntent Agenda provides 
the conceptual ^ underpinnings pf the YEDFA research, evaluation 
and demonstration activities, suggesting the policy issues 
<which will be addressed througli the use of the SAS. Likewise, 
Knowledge Development Under the Youth ^Initiatives discusses the 
needs for such a standardized approach. in order to avoid past 
problem?. , . ^ ' 

The SAS is an ambitious undertaking. It was developed at a 
breakneck pace while implementing the m^ssj.ve array .of 
.demonstration projects gander' YEDFA. There will inevitably 
be problems in design and^application^ Yet standardized 
comprehensive information about hundreds of local projects * 
and tens of thousands- of partiipipants and controls 

/ ^ ' 
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clearly offers unparallele<%opportunity to improve our 
' knowledge of youth employineht problems and how they can be 
overcome. 

Many individuals, particularly the staff of the Educational 
Testing'Service, played a role in the development of this 
system. Hov/ever, the individual who conceived, formulated 
and then implemented the SAS was Joseph Seiler, head of 
research ^nd demonstration activity in the Office of Youth 
Programs during the first 2% years of YEDPA. Bureaucrats 
tend to remain "faceless," but his accomplishment is clearly 
* outstanding and, deserving of recognition. \ 

-. • \ 

\ _ 
\ 

ROBERT TAGGART 

Administrator 

Office of Youth Programs 
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INTRODUCTION 



-The Office of Youth Programs •'Knowledge Development Plans" 
for 1978 and 1979 included .structured sets of questions 
toward which all research, denonstration and evaluation 
activities were to be . directed. i\ major end purpose of that 
ambitious undertaking was to generate systematic and valid 
empirical evidence , which would provide policy related answers- 
to the complex and )pirplexing problems of . continuous youth 
unemployment. ' As noted in the Overview statement of vhe 
report, "Completing ..«ie Youth Agenda: - A- Plan for Knowledge^^ 
Development," Dissemination and Application for Fiscal 1980. 

"In fiscal .1978 and 1979, the major emphasis was^ placed 
on 'knowledge development' through a structured • array 
of multisite demonstration projects, large scale 
evaluations and coordinated research efforts. The 

- first year's goal was to assess alternative interventions 
and delivery approaches., focusing oh the broad issues 
needed to-iegislate more, effective youth programs. In 

• the. second year, anphasis shifted to mor.e specific 
-'..^issues which needed to be addressed in the administration 
of improvement of youth programs, exploring the problems 
of significant segments of the youth Ix^P^jl^tion, assessing 
service components to determine how each could be improved, 
" testing long,3r duration interventions, and promoting 
the integri3.tion of youth programs." 

With these activities in place, the focus ^^n appropriately 
shift to the critical tasks of evaluation synthesis, dissemi- 
nation and diffusion of knowledge, and bridging of the gap 
between- knowledge and policy/prograramatic application. 

one-major evaluative un^Wtaking is represented by the Standardized 
Assessment System (SASr directed at-determini^ 
effectiveness of alternative program approaches. Througft a 
variety of standardized pre-and postr instruments, process, 
4ocill-psychological, and ^demographic data, SAS represents 
'?Se potential for identifying that combination of J;«^J;Vi^ual , 
programmatic, and social structural variables which act to 
ei?her enhance or block occupational, educational, and social 
mobility. , 

The SAS data base is. national in character", representing 
approximately 40,000 young persons at 190, proDect sites. The 
size of the sample, the range of instrumentation, ^and the 
variations in program structure are unique and unmatched by 
p?et?oiseffSrts directed at evaluation of intervention 
strategies and the work/education dynamics of low income 
youth . 



In the gages which follow, the reader is provided with em 
account 6f the origin and development of the instruments 
which are part of the Standardizied Assessment System." 
Further, a detailed description of the experimental design 
and data analysis procedures to be utilized in this major 
evaluative undertaking is included. Finally, a listing 
of reseeurch and evaluative products are identified as 
examples of the kinds of decision tools which can be 
generated from SAS, 




THE STMiPARPrZED ASSESSMEm> SYSTEM 

In order to fulfill the requirement for evaluating a wide 
variety. Qf experimentai and denonstration youth programs 
initiated tmder YEDPA, a "common core" of , measures w^s 
cbnsidered to, be an essential feature of thp knowledge 
development process. Only in that way-cbuld useful systematic 
comparisons be made, between the individual project sites, 
within a given program, a^ well as between operationally 
different prbgraltis of differing, study design. Constraints 
in^ the--choice-'Of"measur-ing-4nstruments_ and the unplementation 
of a Standardized ^fesessmentf System CSASl/were necessarily 
imposed by program differences and by the chara'cteristics 
of the youth, population served under YEDPA, .These cpnstramts 
>stem,^^rim'ariiy, from .three, sources: 

-A dive rsity, of goals ^'or., at least, differing -program 
priorities assigned to ispecific training objectives. 
Some programs emphasize work experience in public or 
^ private sector jobs, some incorporate training for 
specific job related skills and academic abilities, 
while others stress general knowledge about available 
careers or ©onployment prospects (i.e., "career 
deveiopment") and may focus their instructional priorities 
or. job search methods, proper behavior in a job setting 
and improved trainee self confidence. Many programs 
incorporate some aspects of all these objectives. The 
behavioral areas (or constructs) to be measured must, 
therefore, be broad' enough to cover a range of 
intended outcomes and Still be as common to all programs 
as feasible. \ ^ ' 

Technical problems - in the availability of appropriate 

-evaluation-ins.truments_that^c^_on^^ defined ^ 

behavioral constructs but are also designed ror adoles- 
cents and young adults who are from economically dis- 
advantaged backgrounds {i.e., CETA qualified), are 
largely miiiority group members and also trend to 
possess lower levels of verbal skill. Ground rules 
for the choice of such test materials rests with their 
adequacy in format, content, mode of administration, 
reading level and demonstrated measurement properties 
for the youth population being evaluated. 

operational limitations - which dictate ^the need for 
evaluation m easures that can be administered by program 
\ professionals with reasonable levels of ^ training ayd 

Within reasonable periods of testing tiroe (i.e., highly 
complex work samples or observational assessment systems 
' extending over miny hours or days would be considered 
impractical) . The measures should also possess a degree 



of acceptability (face validity) for those program 
^professionals who must administer them a^ well as the 
enrollees who are asked; to respond to them. That is, 
the item content should be seen as ^'sensible" in terms 
. ^6f/program..expectation3_and objectives. 

Major components of the Standardized Assessment System CSA&l that 
are currently being applied to a number of YEDPA programs 
are contained in: 

(1) Measures of th^e participants' characteristics 
* essential for describing the sample composition of 

a given program as well as for use in data analyse&^f 

program effects (evg., to serve as controlling 
variables that al low for statistical- equating when 
contrasts are mad.e between different subgroups of 
^ -individuals) • .That information is obtained from a form 
desigfnated as the individual Participant Profile (IPP) 
that provides backgrpiand and demographic data regarding 
age, sex, race, economic status, marital status, etc^-, 
and from a short reading test (STEP Reading) used to 
measure the student's level of verbal skill, 

(2) In order to assess attitudes, awarenesses, as well 
as chahge-s during the course of! participation, there is 
a psychometric battery composed of seven measures 
siabsumed under 5 behavioral "categories that are intended 
to assess characteristics of participants and controls 
at the entrance point -as well a s^changes between the 
time of participant entry and completion. 

(3) In order to compare and contrast program approaches 
and to ^correlate . these with outcomes, staijdardized 
process information is gathered on each* project, 
describing its qualitative dimensions',^ il^puta and cos^ts. 

— — (A)- — A-performancn'outcome-qtiestipnna-ire-measures- 

the participant's s.tatus at the completion of the 
program (i.e.^ a Program. Completion Survey), his or her 
assessment of the .progj^am experience, as well as staff 
assessments of the participant • 

(5) A follbw-up program survey provides performance 
indices regarding the nature and extent of "success" 
achieved by the individual at the defined time periods 
typically standardized at 3 and 8 months after 
1- rmination. 

As tools that are integral to the overriding demonstration and 
knowledge development role of YEDPA, the instruments chosen for 
evaluation should themselves be scrutinized for their 
effectiveness # ' Some of the variables and scales applied 
here will 14keiy be found more suitable than others • Thus, 
on the basis of their psychometric properties, particular 
instruments may be found more applicable to certain types 'of 
youth programs or to particular subgroups of trainees • 



Results of an examination of the quality of the measures could 
provide the evidence for suggested modifications and improvement 
in measures application and/or design. 

It should also be understood, regarding ' the Standardized Assess- 
ment System, that no single -set of measures could be expected 
to serve all of the evaluative needs of all YEDPA programs. 
Unique features in evaluation design, curriculum content 
and -required objectives of many .programs_.are certain to remain 
so that core data from the SAS are not intended to be the 
exclusive form of measurement information obtained. Hence 
projects have been encouraged to utilize their own instruments 
for local evaluptlive needs. Such information, based on 
measures of r^asopable quality, can bf_. expected to serve as 
a useful supplement to" the overall YJIDPA^AS data base. 
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THE COMPONENT MEASURES AND THEIR RATIONALE 

The instiniments and each of the contructs in the SAS were 
caref ully^ selected^based upon the best available evidence 
iDf validity- rel^^ CETA youth 

populations . More ^bmpr^ensive information would have been 
desiirkble but was npjt adteanis^ More 
cateful testing of the inlltrvanents would have been pre- 
ferable but it was necessary to develop these measures while 
impiementihg certain programs. The ihstrvmientSr which are 
included, for illustyratipri in. Appendix 1 to this report (some 
of the test elements are vendor owned "and may not be used 
without the permission of the vendor) represent the best 
possible compromise between the many constraints at the time 
the! system was implemehtedi 

(1) Measures of Participant Characteristics 

The measures of the SAS that define participant* . 
characteristics (age, sex, race, education, etc*) 
are intended exclusively for individual demographic 
or status information purposes. They provide the 
information heeded for describing the samples of 
youth who- have participated in the YEDPA programs 
and also serve as controlling variables that are 
essential for ±hose data analyses in which groups 
are to be equated, or made equivalent, by 
statistical means (i.e., since the groups could net, 
in any practical way, have been perfectly matched 
or randomly assigned for study purposes) . The 
two instruments used to obtain those forms of 
information are the Individual Participant Profile 
(IPP) and the STEP Reading Test. 

o The Individual Participant Profile 

This document is used to record information for 
49 items dealing with the participant's 
characteristics as well as status in the program 
and at tprminatioh.t These .data essentially 
duplicate the standard information gathered for 
each participant in all CETA, programs;. The first 
29 of these items are largely demographic and 
cover such ihiofmation as the individual's age,. . 
sex, race, economic, educational and labor force 
status - ail at time of entry into the youth 
program.* The remaining 20 items are. designated 



♦These first 29 items are also applicable to control group 
sample members for those YEDPA studies using a control 
grojip ih^ 1*^r ^evaluation design. -r 



as the "Progfafd; Status^* items which indicate the 
-status of the.i^arti^dipant at, the tiin6 of ^program 
compietibn or terroinationi Thesei include- such 
intorihatibn .asiehtc^ 4.a*^es, total 

hours spent p^fticipftihg in the prdgraro, whether 
or not th "the p^^*4-°ipa^^t with 

abaideinic credit, .aiidi specific forms of teirhination. 
status-imdei: ^^sitiye 

A~tset rof^ def init i6ns:iwhij:h.;a^ 
fom defines; eachi item in detail imd how it is 
to be cpmE>leted by j^e youth §rograii: pro j ect 
personnel from their projecfc/recordsv 

Although the itens ?>f the IPP cannot generally, 
be considered its: perioinmarice putcome' (criterion) 
vaf iabiesy sckii^. \fm of' the items^ in the Profile 
ar e obvidusly usable; in. ithat way . For example , 
therti- ar^ items dealing with employ^^nt status 
wl^ich to some extent dupiicate forms of outcome 
infbrmatiph foiirid in the Progr^ Gompletipn Survey. 
These «md. several other . IPP items can sexrve as a 
llmltedrcheck 6£ the reliability of the data . 
obtalTried in the survey by contrasting program - 
prdyided IPP :inf omation with participant-provided 
5 urVey inf ormzttion .-^ ^^^^ 

The STEP Reading Scale ^^^^^ — 

This status measure was specif i-cally compiled ^ 
for pur poses of the YEDPA evaluation studies. 
It is iiftend¥d~tir"fill;~th^~nired--for-a-very-8hort- 
(10 to 15 minute) easily administered measure 
of reading skill that would also cover a fairly 
wide range of the reading levels likely to be . 
found in the YEDPA enrollee population (i.e., an 
estimated range from 4th to 9th grade reading 
level) . ' 

None of the conventional (published) measures 
of reading ability would, acppear to meet these 
particular irequirenients since they are usually 
lengthy, require different forms of :the measure 
.for--widely..'differiri|. ability levels and are 
intended eithef; to define the students' reading 
gradie level, -with some precision;- or identify 
specific skill- deficiencies for diagnostic purposes 



< The sole application of the score from this 20 
it&Q reading^ c6mprehen measure is to serve^ 
as a key varia^^ uses in sub- 

group equating: on verbal ("academic") skill level* 

The 20 i^ems chps for this short reading measure 
were selecte^^^ STEP *^locator tests (ETS^ 

1976I coye^ 4th to 9th ^rade reading levels. 
Those^ locatbt tests ^are short reading .comprehension 

: i^wfeasiff 

devices:/^ deciding which level Id f'^the completj^ 

STEP; ^kc^^^ is: 'suitable for 

admihxstfa a piarticul.ar student. Appropriate 

itCTi and to analyses were xindertaken by 

the publish development of the 

neasurie&V alccuracy of the items 

for readijig gra^ ley^l identification. 

However >; yerif the suitability of this 

specific 20^ for purposes of 

YEDPA evaluatioh can most readily ka determined 
by the leyel pf relationship between its scores 
and scores on some widely used, (published) 
reading meas^^ If a higii degree of positive 

relationship IS found, this 20 item widerange 
reading^ scale can be considered applicable for 
its purposenih the^ SAS, Such data are/ expected 
to be available^ from at least one sample of youth 
program participants during the course bf^ the 
evaluation: collection • 

3 _ 

TKe"^ychWetri"^^ ^ — — ^ : 

Measures chosen for incorporation in the Psychometric 
Battery reflect YEDPA progrart objectives while sti^ll 
being cpmpa^^ characteristics pf ;the 

trainee pdp^^ and the operational qonstrfiiints 

of th^ yout^^^ As the starting point, five 

behavioral categories in whidh trainee perforinance 
changes w%r eff?4cted, as a result of Y^^ 

progrira p^^ def ined by the U. St 

l)#partm^it, 6^ Yorth Prqgraihs.. 

Tlfe^,^>w^^ cdnmion to and believed 

tOril^o^ of a vast;ma3pti^ if 

not allv^f $He^^^Y^^ and were design as: 

(1) career decision maki^^ awareness and capabil^ 

(2) self f image C3) work ^ (4) job i^earch 
capability andv (5) occupational sex ""stereotyping. 

In order to. be compatib^le with the YEDPA participant 
population the meas^x:ei5 chosen to represent those 
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behavioral catsgories should pbssess features that 
make them suitable for low-verbal skill adolescents 
from economically and educationally disadvantaged 
backgrounds. Criticism that has been leveled at 
the design and administration of conventional 
paper and pencil tests used with 3uch groups (Karp 
and Sigel, 1965, Lennon, 1964, Potthoff, 19.66), 
would lead, ideally, to a choice of measures that 
are relatively short, presented orally, contain 
pictorial infojnnation (to supplement the verbal) , 
use a level and style Tbf language appropriate for 
adolescents and youhg^ adults of low reading skill, 
allow for marking of item-responses directly in the 
test booklet - and~permit careful examiner attei;-ion 
to individuaJi respondent difficulties in the. test- 
ing situation (i.e., sm<vll group administration)'. ^ 

"Off-the-shelf" -(published) instruments, suitable 
for assessing required youth program behavioral 
constructs that also meet such des'ign standards, 

-are relatively rare.. Some that might claim 
applicability to ''disadvantaged" populdtions are 
often of highly questionable measurement quality - 
particularly with regard to demonstrated predictive 
validity against meaningful criteria of trained 
performance following program participation. After 
a review of the literature the paper and pencil 
measures that were selected to comprise tlie 

_psychometric battery are considered the most 
suitable ones available, or known, for representing 
the desired behavioral categories. Those measures 
are described below, under each of the five overall 
areas "of their content and a brief summary of the 
available research evid'ence that had been drawn 
upon to justify their incorporation in the psychometric . 
battery. 

Two measures were chosen to assess the career diecision 
makina, awareness and capability performance domain.- 
One dtfals wi'th vocational attitudes shown tc be related 
to "vocational maturity" of adolescents in making 
appropriate career decisions. The second is a measure 
of vocational knowledge dealing with the youth's 
knowledge of what is required for carrying out 
different job functions. 

o Vocational Attitude Scale - This scale. is derived from 
Career Maturity Inventory developed by John Cri.tes 
(CTB/McGraw Hill 1978) . The measure .3ontains 
30 verbal items found in a longer 75. item- 
Attitude Scale (Counseling Form B-1) that are 
scorable as 3 ten-item subsqales. Those scales 
are designated as "Decisiveness" in Career Decision 
Making (CDM) "Involvement" in CDM and "Independence 
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in CDM. The respondent indicates 'his or her 
agreement or; disagreement with each of 30 
statements, about .vocational careers and 
employment • - 



Early versions of the Attitude iScale (containing 
50 items) had been utilized in an extensive research 
project in order to study vocational development 
among students « Approximately 100 studies cited 
by Crites (1971)/ deal with the construction, 
stajfidardizatioh and appli the scale*. 

In esfii^nce the Attitude Scale pas been shown: 
(a) to .differentiate reasonably well between 
students at different grade levels, (reflecting 
increases in vocational maturity: with increasing 
'grade level), (bKto be ^applicable across a wide 
range of educational, curricuiai: and demographic 
groups (^rites> 1971) including studies based on 
disadvarl^aged- Whites, Blacks, Mexican Americans 
and Americai) Indians, and. (cV to be content valid, 
with the Efcoring key matching independent 
experts' judgments of "proper" item response 
at a high level of agreraient (74%). - 

The reliability of ^e measure (its internal 
consistency) for the^.earlier 50 item version 
differs "somewhat as a function of grade uevel 
with a range of correlations from .72 to\.77 
found in grades iO^ 11 and }2. Test-retest 
reliability (i.e., stability)Sof. the scale for 
students tested and retested o^er a one year 
interval was found to be .71 (Crites, 1971). 
These values fdr scale reliability were cited 
by Crites' as representing adequate levels for 
an *attitudinal scale of .complex structure that 
deals with a developmental (i.e., changing) 
construct. . ^ . 

Validity checks with various forms of criterion 
performance involving vocational aspiration, 
vocational choice and vocational maturity, (i.e., 
relationships between" the Attitude sca^e 
scores and scores on those criterion measu:pes) 
resulted in correlations -ranging from the mid 
.20's to the high .30*s* These included a 
^correlation of .38 between the Attitude scale 
and the Readiness For Vocational Planning Sc^le 
(RVP) ;by Gi-ibbons and Lohnes (1968) for minority 
group ' students in the 9th grade^, 
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Job Knowledge > Test (Educational Testing Service # 
1978)- This component is_aC33-it€m^scale^^ 
pictorialJand vcirbal roaterial dealing with various job 
guaiificatibhs, req[uireiQ4hts and tasks • The 
iteink> in multiple choice fomat/reguire the 
respondent to indica^^ response to * 

guestions about the specific occupations depicted* 

Studies with the measure have utilized samples 
of .enrollees in the Neighborhood* Youth Corps 
(N.Y.C.) work experience prp^^ for adolescents 
and the Opportunities Industrialization Center 
(OIC) vbcatiorial training program for out-of** 
school yoving <adult^.. Score distributions based 
on iaeans/ variances and ranges have been, found 
highly similar over^ a nxinber of enrpllee samples 
for males ahd^ f emales< as has the pattern of 
interr-relatiohships between the Job Knowlfedge 
Test cmd other cognitive and: attitudinal measures 
(Freeberg, 1970? Freeberg, 1974 Freeberg and 
Reilly, 1971; Freeiberg an4 .Shimberg, 1974), 

Reliability internal consistency of the measure 
has been found to be in the mid - .70's averaging 
*75, for CETA and Vocational School samples 
{Freeberg and Vitella 1979), with levels of .75 
for a sample of N.Y.C, males and .72 for N.Y.C. 
females. As a scale designed to measure a 
composite, of differing forms of job knowledge 
(salary, educational requirements, nature of the 
work performed p etc.) these reliabilities are 
consonant with what would be expected—baspd 
on similar scales that have been attempted for 
other studies reported in the literature—and 
at levels that justify a variety of t6st uses* 

Validity was determined relative to a number 
of criterion using N.Y.C. and 4DIC samples. Some 
of the criterion information, obtained at about 
the same time as the tpsts were administered, is 
used tQ compute concurrent validity; other forms 
of criterion information were based on longitudinal 
-data obtained at periods of 3 to 12 months follow- 
ing test administration and are .ysed to .determine 
predictive validity. The extent of the relationships 
representing those forms -of validity, using the 
Job Knowledge Test and various outcome (criterion) 
measures/ are summarized in the table below for 
statistically sign*if icanz correlations based on , 
OIC and . NYC samples . 
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Crlt^rljn 



Job Knowledge tett 
Valid ItT Sumary 



^ Concurrent (C) 

Validity 2 Criterion Sanple or Fredlctlvft(P) 

Coefficient (r) Sample ^l2c(N) Relationship _ 



Adjustaant, Factor* 


* 

.28 


OIC (M)' 


115 


P 


irpaxcxva JOD^^urxencacxon 
Factor 


.28 


bic (F) 


189v 


P 


P<^rsonal«»Soclal ' 
djustnent .Factor 




OIC (M) 


115 


P 


Job«^Search Motivation Factor 


.28 


NYC (M,F) 


120 


P 


Training Frogras Adjustment 
Factor 


.25 


OIC (F) , 


189 


P • 


Training Frogram Adjustment ' 
Factor 




NYC (F) 


215 


• ' P 


Work* Supervisor Rating 


.32 


NYC (M,F) 


1C9 


P 


Counselor Rating 


.25 


NYC (M,F) 


109 




Counselor Rating 


.19 


OIC (M,F) 


220 


p 


Vocational Instructor's 


,.2b 


,pIC (M,F) 


261 


•p 


Rating Postt raining Employment 
(Ho/Yes) 


.22 


NYC (M) 


104 


p 


Couriselor Rat Ing 


.22 


NYC (M) 


112 


c 


Counselor Rating 


.19 


NYC (F) 


102 


C 


Work Supervisor Rating 


.24 


NYC (M) ' 


112 


c 



Criterion measures, designated as factors, were derived from independent 
clusters of outcome variables obtained by factor analyses. The 
clusters were, in turn, used to compute factor scores that served as 
the dependent (criterion) measures. A listing of the variables that 
make up the factor patterns is found in Appendix 

^All validities shown are statistically significant (i.e., F-.05 
confidence level or better) 



M • Male Sample 

J « Female Sample - ^ 

MvF » Male and Female trainees combined In a slr4gle sample 



/ The jbb>c-»iov^ledgev Measure, Exhibits- its^ b^ 

/ validit^[r (prediciliyejyyv 

/ratingsV(f'-r^V:32'|>%8.,^^^^ ' a» 

• factbrs" ir-^^^f^^MeCri^o'lii;^-- 2p:*i)\: The •^>. ~- ' ■ 
• g raeasTjfe alsQ 1^^ 

of vaiidXiy fox CHfe- highi^>:impbr^^ , " 

,.of whether ox, nof-the; tfajinee obtained fuil-t.imeo ' 
employmeiit foIlowihg;,;t^ (r. « ,,22; .£or N.Y.C. 

' ■ o Self Esteem Sckle (Educationai Tosting Service/ 
* ' TfTS") - . It is the ol^tefi of 
youth program ft'prbfess'ion^lsi^t^ thie,!^- 
participant' s f eelinqj; of ,pe^^^^^^^ '.'aluet. of . • V 
self-worth, with= €^ 

self perceptions, stimulat^^^ , " . 

of ieSnted social «md .vpca^^ : 

\ . , behaviors. One measufe' wa^^^ 
' .' level at which, the pfograit) paft^^^^^ 

or her pefsbnal value. Ths s^lf-estem scale is 
> a: 15 item scale containing pictorial and vefbal . 
matef ial used to asspss perceived seflt-vforth i|i 
terms of- ^pectation for acceptance , or - 
achievement, in various social, vocational" and 
educational settings. The respondent' iRdicates-, 
on^^a three point scale, the degree to yhich he p 
would bei s.uccessful or receive acceptance in/%he ,i „ . 
-• specific situation portrayed. " ^j- . 1^ 

Studies to support the value of the Self; Esjteeim^.-; 
Scale are based on the same set of datt^obWined ; 
.■^ • f of development and research . use with the Job j 

- Knowledge Testf discussed above, using N.Y,C; 

arid bid: "study, samples. • 

The reliability of internal consistency of this scale 
has been shown" to, average .64 for CETA and vocatibnal 
. Student .sam.ples and in. the mid .50's for N.Y.C. . >. » 

.samples. These relatively modest levels of useful: " . 
reliability represent the lowest ones obta-ined ! 
, Tor any of the measures of the. psy.chcmetrdc battei^. ■ _ 

That result stems, in par.t, ffom the design of the 
scale as relatively short" (15 items) , as weir, as the 
complexity of its item composition dealing with *; 
estimate* of different perceptions of self worth in 
* *• a. vafie'tj of- specific job and interper§:t>rial 

sitviati 



*Mea^»ures that tend to be more complex 'in their content, by 
sainpling' a broader range of the construct under coiisic ciation, 
genefaily stand a ^chance of showing battel validity against 
-^^tinofe .complex critefia^ (e.g., job ad jUstment) . . ■ • ; 

ERJC ; ' . . , • ' . . ■ j--"^ \ 



The vaiidit;^-o^ the self esteem scale using a 

yaxriety of jperfoimgmce pul^^ (criterion) 

measures is siip^^ in the following 

table, which' has^ the semie format as the one 

presented above f6r^ t^ Job Knowledge Test and 

also pi^esents statistically significant correlations 

only^ 



« 



-) • 



^ - 
. V \ 



/ 
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Self ^Esteem Test 
Validity Smnmary 



. - c Concurrent (C) 

Criterion ' Validity Criterion Sample or Tredlctlve(P) 

. .-Measure Coefficient (r) Sample Sl2e(N) Relationship 



Positive Vocational and 



Social Attitudes Factor 


_ .34 


NYC 


(M) 


182 


P 


•Training Program Justment 
'Factor; " - 


.20 


QIC 


(M) 


115 


P 


Jlralxiing^Progra^.Adjw^tment 

Factor 


.16 


QIC 


(F) 


189 


P 


- * 
Overall" Social and 
"Vocational Adjustment Factor 


.26 


NYC 


(M,F) 


120 


P 


Counselor Rating 


.34 


NYC 


(M.F) . 


111 


P 


Worlc Supervisor Rating 


.24 


NYC 


(M,F) 


111 


P 


Remedial-Skills Instructor . 
Racing 


.18 


QIC 


(M.F) 


134 


P 


Woric Supervlsov Rating 


.21 ' 


. NYC 


(F) 


128 


C 



Moderate levels 'of predictive validity .for the Self Esteem scale 
are seen for a criterion factor that measures vocational and social 
attitudes (r-«-^»34Hh)t^NvTvC7TSnerM • Another notable 

validity efficient of reasonable magnitude can be seen in the 
tendency for trainees who have higher levels of self esteem to be 
the ones who are rated as being better adjusFed' (i.e. more 
proficient) by their guidance counselor (r - .34 between the scale 
and the Wnselor ratings for an H»Y.C. sample). 



Work Relevant Attitudes Inventory - Measures of 
work attitudes are intended to deal with the 
youths' views about jobSi the importance 
of working, appropriate ways of behaving in 
job settings and general feelings about one's 
capabilities for succeeding in a work situation. 
Of the two available injeasures chosen as most 
suitable, one deals primarily with personal 
feelings about work, relations with people and 
life adjustment in general, while the other 
deals with judgments regarding how ;one would 
behave in .specific situations that might arise 
in a job setting. The Work Relevant Attitudes 
Inventory (Wai;ther, 1975), contains IS items 
in a short ^form that had been developed. by the* 
author frpm a longer 26 item measure. The 16 
items provide not only "a single total scale 
score, but can be scored on the basfis of three 
-fact6red--subscales-def ined^as,---Optimism^ , . 
"Self Confidence" and "Unsocialized Attitudes." > 
Responses to each of the attitudinal statements 
are based on a 4-point scale ,of degree of ' agree- 
ment with, or applicablity of, the statement. 



Studies carried, out for development of the 'WRAI 
were based largely on samples ^of Neigh^orho6d 
Youth Corps enrollees and students in experimental 
education programs, (e.g., youth correction centers, 
MDTA, vocational high school). Studies were 
based primarily on longitudinal samples with the 
measure administered and readministered over- 
peveral time periods for a number of the samples. 
Measurement' characteristics of the WRAI indicate 
tfiat it is a somewhat' more effective instrument 
for use with females than with male adolescents. 

The reliability of the total ^cale as assessed by test 
retest stability over periods of one year and more 
"is reported by Walther (1975), for N.Y.C. enrollees, 
to range from lows in the .40's to a high of .67, 
with consistently higher reliabilities found for 
females, ^or an attitudinal scale with multiple 
underlying factors, the measure can be considered 
to possess useful levels of score reliability for 
evaluation, purposes . 
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Using Veurious longer 134 item) and shorter (10. item) 
versonions of the WAX, ^validities were found 
to be signlficarit oii' the baisiis of: (a) the 
ability of WRAI scores to differentiate between 
6lack male high, school, dropoutis who xoaide "good" 
arid "poor" adjus'tments to work> and (b) pre- • 
dictive vaUdii^V -the scoies for a criterion 
*bf--%?ork ad'juistmeht/ratings obtained from, several 
inonth^^Q^^s long ^as, 2-1/2 years after adtninistration 
of tiie WRAi;--^^^^ obtained 
ranged from a high-of .44 to a low of .26. for 
females; with the highestvalue of males being 
an r of ;3i. With: a. total sample of males and 
females ccMnbined, the predictive validity was 
highest- for a. second administration of the WRAI 
against the work adjustment -rating criterion 
(r\« .38). ' • ' , . 

Jo^ Holding: Skills ^Eddcatipna Ijrestinq. -Service , 
1978) - This, psychginetric battery component deals 
with-resi>ondent''awareness of .appropriates on-the- 
-job behaviors in settings that depict interaction 
with supearvisors and coworkers. This. 11 item scale, 
containing pictorial and verbal material, requires the 
trainee to indicate which one of three alternatives best 
define what his or her response would be in the 
situation described, (Response alternatives, 
have been scaled to represent "most" to "least" 
acceptable behaviors for maintaining employment.) 

Evidfence -for the suitabilit:y of the measure is 
base^ on longitudinal samples of NYC and OIC, 
fromiwhich item and scale characteristics- were 
determined, and is derived from the same data 
set used for the Job Kndwl^ge and Self-Esteem 
Scales. ' ^ . 

Th§ reliability internal consistency of thie 
measures ^has been shown to be at moderate 
levells of\ .74 for a sample of N.Y.C. ihales and 
.72 ior N;Y.C. females. Samples of CETA and 
vocational high school" students produce reliabilities ^ 
of approximately .60. These levels can be 
considered sufficient for ah' attitude scale that 
is tofbe used for YEDPA evaluation purposes - 
especially! one of such relatively short length. 

\ \ ' >■ ' , ' >. 

• Validity as found in studies with N.Y.Co and 
OIC samples is summarized in the table below. 




Job-Holding Ski l ls Test 



Validity Sumary 



Criterion 
Measure ' 

Social-Adjustment Factor- 



IPoaitive V^jK^^ional- 
Orientation . Factor 

Training Program Adjustment 
Factor 

Personal<*S6ciar Adjustment 
Factor 

Training Program Adjustment 
Factor 



Validity 
Coefficient (r) 

.16 
.34 

•» 
.36 



Positive Job-Ori^ntacion Factor . .21 

Monetary-Expectation Ffi^'rtor .25 

Overall. SBcial anc'i Vocational 

Adjustment Factor -29 

Counselor Rating 'SI 

Work Supervisor Rating 'SA 

Vocational Skills Instructor 

Rating « 'IS 

Remedial Skills Instructor 

Rating , 'IS 

Counselor Rating •^2 

Counselbr Rating . . •26 



Concurrent (C) ■ 
Criterion." Sample or Predict ive(P) 
iSample si2e(N) Relationship 



NYC(M)- 



OIC (M) 

QIC (M) 

QIC (F)'. 
QIC (F) 
OIC (F) 



QIC (M,F) 
NYC (M) 
NYC . (F) 



182 



NYC (F) 215 



115 

115 

189 
189 
189 



NYC (M,F) 120 

NYC (M,F) 111 

NYC (F) 111 

OIC (M,F) 260 



134 
112 
129 



P 
P 
P 

P 
P 
P 



P 

C ^ 
C. 



Awareness, of proper bahaviors in a job setting 
is seen to be pbsitively related - at significant 
levels - to a variety of a^djustments achieved' 
by the trainee. Thus, reasonably good predictive 
-validity -for this - measuire-^^^ in-its- relationships 
to' such criterik-;asi^t raining program adjustment 
fr « .34 for OIC ihaiies ; 36 "for OIC females), 
•proficiency ratings , by work site supervisors and 
guidance couhselors of N.Y.Cl programs (r*s = .34 
and ,31 respectively) and for overall social and 
v oca tibnai adjustment following training (r » .29 
for an N.Y.C. sample). ^ , ► 

Job Seeking Skills Test - To define the capability 
of the youth; to exhibit a set. of /elementary skills 
essential for iihdiertakihg: kn employment search, 
the \J6b Seeking^ :skilrls Test (Educational Testing 
Service, i97iB) has Been adoptied which is a 17. 
item measure ;6f job search capability that 
samples some "of- the;, skills heeded to,.initriate 
an employment search,' interpret information 
about pfospectj-ve jobs (in newspaper want ads) 
and understand tha information requirements for 
filling out a job application. Items in a 
multiple-choice fbrmat require selection of the 
one correct response to each question. 

Evidence .to justify the choice of this measurer 
as most suiteUDle for assessing the job search 
construct is again based on data from the samples 
of NYC and OIC. 

The-relHLxibi4ity--^4nternal--consistency) of the . 
measure^ has ranged from the mid .60's to the 
low .70's in study samples drawn frorn N.Y.C. ^ 
CETA and vocational school samples. These 
coefficients represent useful levels for the 
evaluation purposes intended with the • 
pss;chometric battery. 

Validity as found in studies with NYC and OIC 
longitudinal samples is reported in the "table 
below: • 
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Jpb-Seeking Skills Test 
Validity jSunimary 



priterldp 
Training Prograa 



Validity 

Coefficient(r) 



Criterloh 



Savpla 

Si2a(N) 



Concuirrent (C) 
or Predlctdv«(P) 
Relationship ^ 



Adjustnent Factor; 


.18 


HYC (F) 


2ii, 


• P 


Job Success and 
Satlaf action Factor 


•26 


NYQ (M.F) 


120 


P 


Positive Job Orientation Factor 


.28 


OIC (F) 


189 


. P 


Training Prpgras. 
Ad J us taen^ . Facjt or 




. "OIC {¥/, 


lo9 


p 


Ezxectxve Joo Flannxng Factor 






115 


ft 

r 


Personal*»Social 
Adjustment Factor 


.21 , 


NYC (M) 


182 


P 


Counselor Rating 




NYC (M.F) 


111 . 


P 


•Work Supervisor Rating — 




NYC (M.F) 


Ill . . 


P 


;Po8ttra^ing- Enploynent (No/7es) 


.36.-, 


NYC (M) 


104 . 


P 


Posttrainlng^^Enployment (No /Tea) 


.21^ 


OIC <M.F) 


157 — 


P 


Counselor Rating 


.32 


NYC (M) 


112 


C 


Counselor Rating 


.26' 


NYC (F) 


129 


C 


Work -Supervisor Rating 


.35 


NYC (M) 


102 


c 


Work Supervisor Rating 


.22 


NYC (FX 


128 


c 



In tenns of the size of its significant validity 
coeffibients cye^^^ the j;ob 

Seeking Skills Teist ^f the . 

TOOst valid of thei-SA^ psychom l^attezy^ 

. it shp^s^inqaer^ c?pncuixentVva with 

^ traj^nin^ programi co^ emiS^ ;wprk site sujii^rvisor 

prof iciency ;r^^ TCr^tS? and • 35 for ah NYC sample) , 
as well as predictfy f or those .ratings — 

though at ^^1^ levelSv (^^^^ for work site 
supeifvisorii and •2 2: for TOunselors) It apparently 
possessed the be^ yaiidity of the 

various raeasur^^ the employineht criterion (i.e. # 

' whether orjrnot the former tf ainee found fulltime 
employmertt) i with an r .36 for an NtY.C. sample of 
inales and .21 for a sample of OIC males and females^ 

, combined. ^ 



r 

o Occupational Sex Stereotyping 

*^ Attempts to measure attitudinal perceptions 

toward sex role ster^typM in occupational choice 
have Ibjsen relatively j^^^^ and rare* The available 
ihkii'#iient8^^ t^ with such a construct 

have either bec^xi 4a ): aiin^d at ^yoimg-children (for ' 









^- ^ 

JT ' . • 

y ■ 

V' - 


■ - . • . { 

developmental study purposes) , (b) designed for 
and develpped with, samples of young adults who 
possess reasonably High Verbal skill ■levels 
(usually majority gjrouji coile^^^^ 
(c) embedded in broader measuries dealing with 
genefairaspects e^^^ 

the purely vocationai-. Few scales dealing with 
occupational, sex stereotyping hay^ undergone • 
systematic ..study of : their xttM 
" characteristics and th^re is virtually no direct 
evidehce for lihe validity of such scales based - 
on vocational perforinance criteria Ce.g, , job 
entry, or vocational adjustment criterion measures). 




's' 
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One .available measxire was chosen iEor use in. .the 
psychometric battery to deal with this behavioral 
- ■ -x-category or cons€tiip,t.' Ho.weyer,., any measure of 

vocational .sex stereotyping developed'thu^^ far. must 
be seen as no -more; than, a sensible ..conpromise and 
V of tenuous value pending evidence from youth 
- program evaluation studifes regarding its suit- 
- ability for a YEDPA population. 


"t 


i * 
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The Sex Stereotyping of Adult Occupations Scale 
was developed by Garrett, Ein and Tremaine, (1977) 
and used with, elementary school children from 
1st to 5th grade. This relatively short (21 item) 
verbal scale presents job titles along with a one 
sentence description of each job and requires the 
j.e5p««ri*»r,4- ¥n 4hfl-!r!afe "who should be a " '" 
(job title as given). A five-point response scale 
ranges from "Only Women" to "Only Men". 
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The 21 items are categorized and scorable under 
three gender. <3esignated groups of "male", 
"female" and "neutral" jobs, with seven jobs 
(items) assigned to each of those three categories. 
Although previously applied only . to grade school 
students, the measure, baSed:bn its format and 
content, was considered the most readily adaptable 
. one for low verbal skill, economically disadvantaged 
(i.e., CETA qualified) youth. 
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.. '• ' ® 
The choice of the Sex Stereotyping of Adult 
Occupations Scale is bas^d on a coherent research- 
supported rationale in the development of its item 
content and scoring and' on^^its internal ineasur.eraent 
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properties .(Garfettr Ein, and Tremaihe,. 1977) • 
Thus, f or . example, of an it^m pool was 

based on achieving r^prese^^ of . -jobs with 

different levels; of educational riequirements # while 
the assig^ 1:o-g<^der categories was 

V. y -based; on /Census Buf^ ihfoihnat ion regarding 

distributibris by seic for the jobs described. 
Items wer^ also pretested in termi? of tJie effective 
'* ness of ithe 5-*^ alteirnative format . 

and selection of items for the final scale was 
based bni iteb measturement characteristics along 
with analyses of sex' and grade Tevt^l effects. 

^Reliability internal consistency of the scale, as * 
is reported as ranging from levels of .85 to .90 
for a sample, of" elementary school children. An 
exaaninatibn of test-retest stability by Garrett, 
Eih and Tremaine (1977)^ showed reasonably stable 
scale means over :a one mbh^ time period in a 
grade school sample> 

Validity in the form of direct criterion- 
related evidence has not. yet been demonstrated 
for this (or any other) measure of occupational 
sex -stereotyping. Such validation may be_ 
considered part of the YEDPA knowledge development 
effort amd will be undertaken as performance 
criterion information becomes availeU^le over the 
course of the evaluation studies. 



Each of 7 measures of the psychometric battery 
discussed above were chosen, not only for their 
measurement quality, but also because 
administration requires a relatively short pe riod 
of time. The total psychometric battery can be 
administered within^a reasonable time and, where 
required, in a single sitting (e.g., especially 
important in attempting to test control groii^j 
students). On the average the total time for 
administration has been found to be about 80 
minutes. 

An Administrator's Manual is provided along with 
directions for oral presentation of all test items 
to small groups of respondents. Item responses 
are marked by the respondent directly, on the 
page .where the item appears. The psychometric 
battery is available in English as well as in two 
Spanich language translations - one form represent- 
ing a colloquial language style and the/ other a 
more formal style. 
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Project and Process Information 

To .gain a better uriaerstanaing of the factors that 
mayraccoiait for aif fjerei^ program effects on , 
^rticipants, it is necessary to know the specific 
service mix, -the, intensi^^^ of services, the types 
of expehaituresV the ievel iana qualifications 
of. s^aff, the stability. of operations, ahd the 
-project conipiexity as- jiidgea by linkages w While 
the various demonstrations have a variety of - 
organizational arrahgeroents a: id funding routes, 
it is at the local, project level where effectiveness 
is determihedi Even though the demonstration- 
designs tend' to hold constant certain key eleanehts 
of service Mx and client- groups,- there_are _ 
significant variatibns among projects which 

explaiTrmany of the dif f erences -in-outcomesT, — A 

battery coiitainxng six sets of questions seeks to 
translate Tcey site-specific variables into , 
quantitative terms . —Fir st7~b'asxc information 
is gatheredv about the sixe and sponsors of the 
project as well as the setting. Second, the project 
is described in terms of component services and 
activities as well as principle goals. Third, 
the linkages . involved in the project are described. 

Fourth, there is a profile of the staff involved 

in the project.. Fifth, project stability is 
assessed as well as the .position of the project 
on the learning curve. Finally, the project costs 
are measured in a standardized fashion. 

These descriptive measures were f eveloped by a panel 
of practitioners and. process evaluators basea 
upon judgments about the key dimensions of local 
p?ogriun effectiveness and the ways these^ could 
best be described. There has been very la^^^ted 
previous research . linking . such process measures to 
Outcomes and the use of the specific descriptors whicn 
haye^een developed is clearly exploratory. 

The Performance Ou tcome Measures 

The outcomes of programs are determined by a series 
of indices applied at completion and at two 
oferiods following program departures. These indices 
§5inf thSSu?Llnd%xtent of T success" or outcome 
achieve^erbs realized, both ij^he short tem (at 
program completion) and over the longer term^Cpost 
program time" per iodg).. Two questionnaires contain 
the Items developed for this purpose. One xs 
deIign??edtJe -Program completion Survey" and the 
other is the "Program Follow-up Survey. 
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Program Completidh /Survey " ' 

This quest^^^ jnost of 

which Jire phra to be presented 

to th€f yput^ at the time he 

ofc she has comp^ or isi leaving the training 

proq|ami They coVe^^ activities, 
in the 'progr prpgreim, 
job ^and educ^ aspirations >and. :'expectajbions* 

and social • cbiranuh^^ ,ad j us tm^nts • These 
questions ar intended for -oral presentation, 
on anj indiyi^^ basi6 r by an interyiewerv with 
the ehroUee*8 Stem responses- to be recorded by 
the interyiewer* items obtained by thfe ' 

inter|yievfer f ^ the program files are number 
of days, abse^^ f rom -tiie program and number o£ 
wprk sit>s^ if any^ to- which the tr ainee wa s 
assigned during ^ Other program 

..cpmj^letJ.;© at the same 

time;/ are- two i>rpf ic;^^ rating sbales* One is 
an 11 iteon Coimseipr^ Form, to be completed 

by the youth program, professional who had served 
in the guidance atnd counseling role for the 
participant* : The dther scale, containing 10 
items ^ is the Wbrk Supervisor's Rating Form to 
be completed by the participant's work-site 
supervisor (for those participants enrolled in 
a work experience program) . 

A number of the questionnaire items can be 
grouped to yield meaningful svibscales that 
define outcome diihensxohs of (1) Work Motivation, 
(e*g*, feelings of vppatiohal adequacy, saving 
of money, willingness to accept further training, 
motivktion tb/wofk, awareness of job characteristics), 
(2) I Sociell Cbxnmunity Adjustinent/ (e,*g», family 
adjuisitmehts, gettihg albh^ with people in the 
community,, avoiding ,proM<^ law enforcement 

agencies);, (.3) Training Program .Adjustment and 
(e.g., Isounselbr^ proficiency ratings , absences . 
from the training program/, wbrk^^site supervisor 
pro-iciency ratings ^ working on or having obtained 
the GED, knowIedge^bf, desired ;;job) > (4) Vocational 
Planning Competency,, (e«:g«, level of long-term 
and short-^term jpb plans, ability to accomplish 
plans, knowledge of what to ask a job interviewer, 
awareness of job characteristics, quality of first 
job sought.) 
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A ^parallei'' queit^^^^^ cbntaiiiing timilar 
it«n Bjat^at iii".;ayan uie with control 

9rbujp>^nend>ef i| the "Control 

Group Status Surv ^ 
prpgrami whose ibvaliiaitip^ cal|,8- for 

^'ijncorixiratiort ' < 

F6il6w-up Proqfain -Survey 

This 5b itip^ questionnaire is also to be 
aainihisteredl oraliyV bh an individual basis, by 
th* interviewer who? is to record tAe jparticipant's 
I responses i ;The Survey is presently inte^^^ for 
use. at periods' of 3 ^months after the participant 
has- left the •training prograin and again at 8 
iiabnths f qiiowlng- pto 

items diiil witA; t^^ 

training wcpiriencias in areas .of employment, 
educit ioiiv and- social ad j v.s traehts and future 
plans. In additibh, there is< a 5 item Employer 
Rating Porm which is itbJbelcompleted by the 
present (of iSbst recent) employer. (Permission 
to interview, the -anployef . must be granted by the 
youth.) 

Performance dimensions (subscales) that can be 
formed for scoring responses, by grouping items 
of the Survey appropriately, consist of: (1) 
Generail Social and Vocational Adjustment, (e.g., 
employer |>roficiehcy rating^ family adjustment, 
cororouhity adjustment, amount of trouble with 
police, einipldyed vs. not employed, at the time 
of interview, saving of money, perceived impcfrtance 
of heepirigf but of trouble), (2) On-the-Job Success 
and Satisfaction:, (eig., aroplpyxnent and earnings 
experience since leaving program, starting 
salary in job, top salary expectations, hours 
worked per Week, level of job satisfaction, extent 
to which job expectations were net, amount of 
.school att-ehdahce) ,; (3) Job Search Motivation, 
'(e.g. , number^of places; interviewed, number of 
applications filed, ,number of sources used to 
find first job, hianbef of visits to State 
Employment Service, time sp^'-t on present or 
last job), (4) Job; Planning Competency, (e.g., 
"quality of next jbb sought, level. of short- 
and Ibhg-fange career plans, q\iality of .present 
or last 'job, amount of school attendance) , (5) 
Short-Range Job Succefi»> Je.gii time to^ind 

first job, number of places interviewed, saving 
of money, time on i?resent or last jobi obtaining 
of salary: raise, knowledge of next job sought). 



A parallel version of this. survey is also' 
available for use with control group members 
and is designated as the '•Control Group Pollow- 
up Survey. For all versions of the Program 
Completion and Follow-up. Surveys^ detailed 
interviewer instruction forms are provided thcit 
deal with guidelines for item presentation. 



The phoice of items to be incorporated in the 
performance outcome instruments was based, in part, 
on previous research designed to show their 
applicability as relevant performance dimensions 
for youth work training program enrollees 
(Freeberg and Reilly, 1971; Freeberg 1976). That 
research had included first, the rational choice 
of variables that encompassed stated objectives 
found in enabling manpower program legislation, 
^information obtained by examination of work- 
training progremi practices arid curricula, and 
interviews with program professionals. Second, 
these variables, representing desired performance 
outcomes, were administered to cross-sectional 
and longitudinal study samples of youth-work 
training program partipipants and analyzed to 
determine which of them formed coherent and 
interpretable clusters. In addition, the value ^ 
of the various short-term outcome variables (i'.e., 
at program completion) was examined by determining 
their relationships to the longer term (post- 
program) variables. 

Resulting clusters of outcome variables, as 
summarized above, were found to be similar in 
studies- with enrollee' samples from NYC and 
OIC programs. Major variables that comprised 
the performance outcome dimensions were, there- 
of ore, chosen for incorporation in the outcome 
surveys for the SAS. This provides not only a 
justification for choosing the i^ems of 
demonstrated' value (relevance) but a way of 
obtaining meaningful grouping of items for scoring 
purposes. * , " 
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VALIDATION OF SAS INSTRUMENTS UNDER CURRENT DEMONST RATION PROJECTS 

Infonnatioii preJente^ previously dealt with' the background, 
rationale arid available' evidence used to support the choice , 
of measures incorporated in the SAS.. These instruments and their 
app];icability will- be further refined and validated as data be- 
come available from the deibonstration projects, in which they 
aire applie^d.. One of the first demonstrations to be launched 
utilizing the SAS is the Youth Career Development or YCD 
demonstration which provides coxinseling, career infb^ation, 
job search assistance, placement, motivational training and 
other transitional ^services to high school students. The 
psychometric" bettefy of pre - and post-tests are available for 
.3000 participants and control group students. Outcome 
(criterion) information .has also been obtained for this in- 
school .sample from the Program Completion Survey, administered _ 
to thoise high school senior class, participants who had remained 
enrolled in YCD for 60 hours or longer. Finally, three months 
-folldW-up data are available for nearly 800 participants "and 
controls wh6 were served during the course of treatment. 

'lA-L, there is an oppo.r*:unity to utilize these short-term 

criterion data, from one of the earliest YEDPA programs, for an 

initial' examinatiofilhOf: (a) the internal characteristics of 

the SAS meas\ires -when applied to participant and control group 

samples (i.e., means, standard, deviations ,. score ranges, reliabilities) 

(b) some limited forms of construct and criterion-related 

validity for each'Of the seven measures?, and (c) possible 

contrasts with findings from prior studies —presented earlier 

in this section— as an indication of the stability, of the 

measures and their suitability .for evaluation purposes with an 

in-school YEDPA sample 6f high school students. 

The following Table presen*-s the acal^ characteristics of each of the 
seven sets of measures in the psychometric battery. From these 
results it can be concluded that: 

(1) Mean scale scores, standard deviations and score ranges 
represent reasonable values for the distributions of 
' -these measures when used with a disadvantaged, 
CETA qualified, largely minority group student 
population— particularly so, since -this is a sample 
that is relatively homogeneous by virtue of its 
composition . 

From the means and variances, it can also bs seen 
■ ' that the measures gsneraliy possess sufficient 

^ spread ' between • their mean scores and the highest 
possible score on the scale, to minimize any ceiling 
• ' effects (i.e., "topping out" on the scale).. A simple . 
index of the degree to Which a ceiling, effect is 
likely to be experienced with eacji measure is- shown 
in co?.umn 4, jis^a ratio based, on the "difference 
•between the mean and the highest i^ssible 
score divided by the standard deviation. Customarily 
* a mean, that is at least one standard deviation from 
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SAB M«««ur«« 

'VocadonaUAccitude 
,(VA). 

Job Knowledge (JK) 

job Holding Skills 
(JUS) 



.Vfork Related 
t iActicudea Inventory 
/ (MIAI) 

Job Seeking Skills 
(JSS) 

.:Sex Stereotyping 
; (SS) 

. ^Self Esteem (SE) 



I 

Test 
Item 



aiarscteristics of the Piye^oaetric Battery Measures 
Pretest Adninistrationt YCD Seniors* - 

r 

(N « 1666 Participants; N - 1590 Controls) 

2 3 i i i 

Ceiling • ' 
S!ffect In 

Standardized • 
... Units Mean Dif f 

Mean Standard Dev (Perfect Score- ttxt- Reliability 



30 

30 
11 

16 

17 
21 
15 



Part. Controls 



21.5 21.6 

22.5 22.8 

30.7 30.5 

49.4 49.7 

12.5 12.8 
'"45.8 45.8 

36,7 3^.6 



Part. Controls 



4.3 4.1 



3.6 
2.2 



3,4 
2.3 



6.7 6.7 



2.5 2.5 



8.3 8.3 



2.9 3.0 



^Complete data cases only 



Mean/SD) 
Part. Controls 



1.99 2.06 

2.TJfiv. . 2.12 
1.02j/ 1.07 f 

2.16 2.14 

1.70 1.66 
2.06 2.07 
2.83 2.76 

6 



Controls 



HS 
NS 

.01** 

NS 

()S 
NS 



NS 



V- {NS • Non significant Heattttfi^ference between Participant and Control group students 
rv, **Nean' difference significant at P <..01 / 

■ 41 . ■ ■ I . 



(Alpha) 
Part. Controls 



.76 

.67 
.56 



.73 

J)" 
.55 



.78 .77 



.66 .66 



.90 
.58 



.90 



.61 



Score Range 
Part. ControlB 
7-30 «r30 

1-30 6-30 
17-33 " 19r33 



4 " 



28-64 28-64 

1-17 1-17 

21- 63 23-(53 

22- 44 22-45 



00 
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the hishest postible. score wuld be desirable, 
where 'the evaluation measure is to be used in order 
to show change over time (i.e., a pretest, post- 
test gain-score analysis). Although all psychometric 
, measures meet that approximate criterion, the one 
measure that is obviously borderline in its 
sensitivity to. a ceiling effect, is the Job Holding 
Skills scale. However, evidence of its validity 
shown in prior- studies and some of the validation 
e^^idence to be presented -below indicate^ that the 
measure possesses a sufficient degree of useful 
variance to qualify for the evaluative purposes of 
this battery. Attempts to increase the difficulty 
level (i.e., reduce the ceiling effect) of a Jobj 
Holding Skills type of construct have tended to J 
increaiBe the complexity of the job situations 
portrayed to a ^Jbint where it^becoroes; one of cognitive- 
verbal comprehensioh, - when used with- a low ve»bal 
skill population^ - rjather than a measure of awareness 
pf how to behave in a job setting. 

Reliability (internal consistency) of the 7 scales as 
(column 6)" ranges from r's in the mid ,50's for ^ 
the Job Holding Skills measure to ,90 for the 
Sex Stereotyping of. Adult Occupations scale. 
Overall-, the reliabilities are comparable to those 
found in prior studies and represent sufficient 
levels of internal consistency for evaluative uses. 
The generally lower reliability of the 'JHS scale 
is coramensursCepwith its having. the fewest items of 
any measure .in the battery (i.e., 11 items) and can 
be considered a reasonable magnitude for such a short 
scale with complex content. 

T^ere is. a fairly 'high degree of similarity between . 
the YCD participants and the control group members 
with regard to their psychometric battery performance. 
Dif f€5;:ences between mean scores for the two groups 
aire not statistically significant for 6 of the 7 
measures. The one exception is the- Job Holding. Skills 
measure which, although statistically significant in 
its mean difference for the Participant and Control 
groups (at the P« .'01 level), is negligible in terms 
of "practical" significance with a mean of 30.7 for 
participants and 30.5 for controls (barely one tenth 
of a standard deviation) . 
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This •xamination of validity of the measures of the 
psychonitric battery is baseid on two types, of analyses from 
availabl« data of the YGD'.prograro. - One is a brief and general 
form of construct validation^ for which the intercorrelations 
of tihip ii^ven measures can; bemused to see whether the broad 
pattern <ff relatiohships. is sensible or interpretable (i.e., 
whether the c^l^tained' pattern of relationships is consistent 
wi€h the constructs intended! in the design .of the measures). 
The second is the. moxje imTOrtaht and. mezmingful criterion - 
related yaliiaatlon pcssible with a variety of performance out- 
comes, limited for, this analysis to a select gx:oup of short- 
term (program completion) -diriteria of trainee capability and 
jadjustment, 1 

I 

(1) Construct Validation - 

* ' . • *• 

. The collowing table presents the 7JK7 intercorrelation mat 
for the psychometric battery measures for the merged 
participant and control group samples. The patterns 
of relationships in either sample are highly, similar 
as might have been expected from the considerable 
similarity already shown for their score distribution 
indices and reliabilities* Other points to be high- 
lighted are: v ^ 

# 

(a) The correlations , which are all statistically 
significant at the ,01 confidence level, show 
sensible and logical patterns of relationships 
that tend to support broad aspects of construct 
validity. First, these largely vocationally- 
oriented measur'^s^s are all found to have a 
positive relationship to one another* Second, 
/Stnd more important, the two major categories of 
measures that can be reasonably defir\^ed, as 
attitudihal ' and cognitive / have their \appropriate 
interrelationships within their appropVi^te 
category. Thus, the measures intended to 
represent .cognitive ability constructs— ^i.e* , 
Job Knowledge and Job Seeking Skills— display 
their highest correlations with one another 
(r « .51 for the participant ^group and •52\for 
the oontroi';;gro.up) • Similarly, those measures 
designed to assess clearly attitudinal perceptions 
are most highly interrelated- —e»g. , the Vocational 
Attitude Scale and the Work Related .Attitudes 
Inventory s^ow their highest relationships with 
one another (r « #54 for Participants and .48 
for Controls) in contrast to their Idwer 
correlations with the cognitive. ability measures* 
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Ftychometrie Bfttt^rj: Itifcercorrelation .Matrix* 

> 

YCD Senior Santple 

'(Participant N • 1666; Control H » 1590) 





• 


VA 


JK 


JHS 


WRAI 


JS'S 


SS 


SE 


VA 






38 . 


27 


54 


37 


32 


27 • 


JK 




33 




30 


38 


51 


24 


(23) 


JHS 




29 


31 




39 


32 


21 


27 


HRAI 




^8 


39 


40 




41 


3i>, 


43 


JSS 




37 


52 


3? 


42 




24 . 


29 


SS 




24 


22 


18 


33 


22 




16 


S£ 




25 


24 


28 


' ^3 


31 


18 





* P«tlcip*nt« above diagonal; control group below. All r'« arc 
significant at the .01 level. Decimal points are omitted. 
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Additional evidence iriv of construct validity 

cism otmd^ between the STEP. 

Re aiding Tes js ah& ^^^ the^ps ychometri c battery measures • 
If the / qognit ive ^and: a€titudinal constructs \inder- 
flying thfe"?5m^^ ire Ipgical^ it wbuld be. ^pected 
.that the prdlnia TOghitive p (JK 
and JSS); wbulld . jbe^^^^^^ correlated with reading 

skill than the, attitudi^^^ Bfcales< Thi^ is pre- 
cisely what is seen £0 occur for the ^Relationships 
shown be ioW^ between each psychometric battery 
measure and the 5TEP Reading Test/ 

Psychometric Battery Correlation With 
Measure STEP Reading 

VA . .34 
JK .41 ^ , . 

JHS ' .28 

WRAI .38 
JSS . .50 

SS .25 
SE .24 

<. 

(b) Among the four measures tJK, JES, JS& 

arid S5) r for which there is prior evidence regard- 
- ing their intercorrelations, the relative size 
of these relaftionships in the present YCD sample 
is fairly similar to. previous findings with 
youth-work training program samples of N.Y.C. 
and OIC enfollees. . , 

\ Of the psychometric battery measures ^ the WRAI 
^ is found to have the highest correlations^ over- 
all^ With the other measures in the battery. In 
partf this is because its attitudinal item 
content overlaps to some extent with the types 
of items used in the Vocational Attitude scale 
and the Self Esteem Scale; But, the measure, 
also displays the strongest relationships of any 
of the attitude scales with the two cognitive 
measuresf of JK^ and JSS, as well as with the ^ • 
STEP Reading Test. Thus> it is, the one measure 
of the. psychometric battery that most clearly 
cuts across both cognitive and attitudinal 
aspects of test performance. By contrast the 
measure that has the lowest overall level of 
relationship to the other SAS psychometric measures 
for either participant or control groups (i^e., 
the most independent or unique measure of the 
seven) is Sex Stereotyping of Adult Occupations. 
The finding is a logical addition to evidence 
for construct validity, in view of therelatively 
distinct intent that seems to underlie the rationale 
or purpose of t:he SS scale and the subject 
matter that defines its item content. 



:t-2) Crit eriohrRelated ValidatiQri . 

fifteen variabies: contaiihed iii! the Prograin Completion 
Survey constitute tie- sh^brt-rtem trainee performance 
butcdmes -(critef basis , 

-.for this initia^^^^^ 

vaii'di% tof elcb ^^^^^ ^ 
ineaswres. These 15 eriteribn vaf ^.ablies are identified 
the fbriowihg /table which presents the statistically 
significant, correiatibns (i>;e. » . validity coeff icients ) 
obtained between" each 6f tilife criteria arid the 
psychometric battefy measiires in a 7 X 15 rectangular 
matrix. ^ These dati afb. ^^resented; for the YCD. 
participant seniors^ :wh9 had been enrolled in the >rogram 
during the l:)78-79 . academic; rtonained in, YCD 

for at' least. :60 hbyrs of program . ^ 

yol^tariJ^ agreid'"t^ 
• Survey. ^ " . " 

■■ ' Three of the criterion variables from the Survey 
represent multi-item scalies — i.e., the Peelings 
of Vocational Adequacy Scale (6 items), the Awareness 
of Job Characteristics Scale (6- items) and the Counselor 
Rating Form tH items). The respective reliabilities 

^ of the 3 scales are .56, .5fr and .89 (as internal 
consistency frbni Alpha coefficients) . The shorter 
6 item scales are near the lower boundary of 
reliability desirable for criterion measures (though 
still useful), while the counselor proficiency rating 
scale possesses a substantial level of reliability. 

For ease of interpretation, as well as more meaningful 
and practical value in any discussion of results, 
, the validities shown in the following table are those that are 
'f at r « .10 or greater and significant at the .01 
V^(P'« .01) or better. From that table, all measures 

of'^the psychometric battery are seen to possess some degree 
of statistically significant validity against a number 
of th'fe criterion measures at program completion. Of 
importance in this pattern of significant relation- 
■ ships is that all" are in the expected or logical, 
direction, sucE~that a higher (more favorable) score , 
on an SAS measure is associated with favorable , 
criterion performance. It can be noted, that it is 
also true for the three x = - .10 values shown on ^ 
the "Lowest Hourly Pay Acceptable" criterion in. 
that those participants with more favorable attitude 
scores on the JHS, WRAI and SS at program entry^tend 
to be the ones who, at program completion, would he 
willing to accept the lowest hourly pay in order to 
obtain a desired job right now (i.e., more motivated). 
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- . . Psychometric Battery Vaiidities Using 15 Program Conpletlon Criteria; 


\ 




:^ 


4* • - 


. - *' 




Work 




sex 


• 








♦ 

< 

Program'Completlon Performance 
. Outcome^ (Criterion) Mea^ 


Job 

Vocational Job Holding 
Attitude Knowledge Skills 
(VA) (JK) (JllS) 


Related 
Attitudes 
Inventory 

(WRAI) 


Job 
Seeking 
Skills 

(JSS) 


Stereotyping 

of Adult 
Occupations 

(SS). 


Self 
Esteem 

(SE) 




- / > 




-> 1 .'Faviily Feelings^ '.about Progrm (40)^ 






• 


f 


:i3' • 






-vw^— • 

. 


2. Change In Getting Along with 
Family (39) 








• 






; . -> 




3 1 People Giving Hard Tl^te (44) 




.14 














4 # Days Absent From Program 












1 
1 






5 Satisfaction with Program (12) 












A 




6 Trouble with Police (45) 

i JLmp • i^eepxug ouc o& iLOUDXts v^^/ 


.11 .14 .17 

12 


.14 


.15 - 




.18 

.15- - 


r 
















O ^OD wOVlXu LiUOIV fUL OLkcL &LU|(L<IUI 

(34) 


.10 






.12 


.10 




• 




9 Job would Like Best Now (35) 


.12 .12 


.10 , 


.14 


.18 


.15 








10 Lowest Hourly Pay Acceptable (36) 


-.10 


-.10 




-.10 


• 








11 Knowledge of Desired Job (37) 


.12 










• 






12 Willingness to Enl;er Training (38) 


.22 .13 .12 


.26 


.16 


.15 


.14 








13 Feelings of Voc Adequacy (22-27) 


.16 .13 


.23 


.16 




.27 








14 Awareness of Job Char. (28-33) 


.10 .15 .11 


.20 


• lo 




.18 


• 




148 


15 Counselor Rating 


.17 . .16 


• 18 


. .11 










^All r*a shown are 'significant at the .01 confidence level' or better 
^Numbers in parentheses refer to item numbers in the questionnaire 
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Overall, in terms of number _and magnitude of significant 
relationships, the Work 'Related Attitudes Inventory 
possesses- the best predictive validity against these 
shortdberm outcbmes. With i'tf? highest validities for 
the trainee's expression of willingness to enter, a 
•traini-ng program, in- order to obtain a. desired 30b 
(r = .26) /• Feelings of Vocational Adequacy . (r = .23) 
and. counselor Rating (r « .20). The WRAI is followed 
closely in levels of validity 'by the Self Esteem 
measure and the Vocational Attitude .Scale. The 
patterns for those three attitudinal scales are 
.fairly similar, although the Self Esteem Scale seems 
to evidence better validity with s<2V3ral social 
adjustment variables, than do' the other two scales - 
i.e.. Family Feelings About The Progr^, Importance 
of Keeping 'oute-of Trouble and the highest relatioji- 
ship of all {r.j?!: ,.18) for Amount of Trouble With 
Police. . ■ • 

Of the psychometric battery cognitive skill measures, 
the Job seeking Skills Test displays s&mewhat higher 
levels "of validity with the job-oriented criteria 
than does Cob Knowledge. - ' 

Genorally, criterion variables for which psychometric 
battery measures demonstrate their 'best validity are 
the job-or.ientsd ones and the* counselor proficiency 
rating; vlrUe the personal and social adjustment set 
of crite-in ?:l.e., family-community adjustments, 
satisfaci^- A with the program, .absences from the 
program) ai.4 comparatively negligible, "^^^f^^f^ 
only one social adjustment criterion for t^^hich the 
psychometric battery meelsures are almost uniformly 
significant predictors Ci.e., valid) and that is the 
-Amount of Trouble With Police" onl^ tbe SS measure 
fails to correlate significantly with that outcome. 
Those trainees who obtain high scores on the 
psychometric battery measures Ht program en ury 
tend 'to report, at program complet.'.on, that they had , 
^ less trouble with police during the- course of their 
enrollment. 

Any comparisons of these results for an in-school 
yCD sample with those of prior validity .studies using 
similar criteria must be made cautiously (especially 
since prior results'were based largely on unemployed 
school dropouts in N.Y.C. and OIC work-tram-cng 
programs). Not only .are there differences %o be 
^pected between in-school a.id out^-of-school samples 
from different types of youth programs out, in addition, 
many important criteria that were found valuable at 
program completion in prior studies are not logically 
applicable to an in-school program that does 
provide a stipend (e.g., work-site supervisor proficiency 
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ratings, trainee financial management of income 
derived from the program, whether or not the 
trainee ie working toward, or obtained, a 6ED) • 
Furthermore, for three of the seven measures of 
* the psychometric battery {i.m., VA, WRAI and SS) 
e thete has been little or -no previous study of their 
validity with the assortment of criteria utilized 
here. \ Nevertheless, there are some geneVal similar-* 
ities with, prior results for the four measures for 
which such direct contrasts are possible* Thus, 
for example, it can be seen in the present validity . 
results that the JK> JHS and JSS measures each tend 
to be significantly related to the counselor rating 
criterion while Self Esteem is not* This is a 
result obtained previously with an N.Y.C. sample 
(Prjeeberg, 1970). In all previous validity studies 
the four ETS measures had also tended, tp produce 
significant validity against the social adjustment 
variable of Amount of Trouble With Police and with 
\ the set of criterion variables involving job-oriented 
\ perceptions of the trainee^-as was evident in the 
\ present study. The only area of discrepency, however , 
exists in the value of the social adjustment criteria 
\?«g«f variables involving family and community 
adjustments, program absences, importance of keeping 
out of trouble) for which these four measures had^ 
tended to shoi^ a pattern of more extensive significant 
validities for an outrof-school sample than are 
found here for high schpol seniors* 

Although\the. magnitude of the significant predictive 
validities obtained in thi^ study are relatively 
low, with most of the correlations in the teens or 

. low «2Gi^'s, the patterns are indicative of the potential 
value of these psychometric battery measures ^s 
program assessment tools* Distortions that serve 
to minimize th^ extent and degree of validity obtainable 
are oft^n a function of (1) the quality of t^e criterion 
data collected (for this study all data were collected 
by the YCD project personnel) and (2) possible sample 
biases from restrictions in^ the range of performance 
for the sample . from\which the criterion data could be 
obtained. Thus, forthe present study, validity would 
be expected to be weal^ened by the fact that there is 
a reduced sample of about 970 YCD senior participants 
available at program completion from some 1,660 
originally pretested at program entry. Since these 
students could be assumed to represent those who 
were motivatec^ enojigh to reit^in enrolled in the 
program^ it might also be assumed that they represent 
a sample who are more restricted in the range of 
tiieir program completion criterion performance (i«e«^, 

^ clustered, hopefully, at the iiigh or more ^'favorable"* 
end of the performance distribution) - a result that 
would unavoidably- serve to minimize the magnitude of 
the validity coefficients obtainable « 

51 



in the following table, the long-term predictive validities are shown 
for the 7 psychometric measures , using criterion variables from the 
Program yollowrup Survey adtitiriiitered to the YCD participants 
thrii aio'nths -af W the end of t^ieir senior academic year. The 
correlations (validities) presented in the rectangular matrix 
represent those that ^are significant at the ? « .05 confidence 
i'ev«I, or bettirv/ and of a magnitude of r's « .10 or larger. 
The . 05 level was. considered a more sensible standard^ f , 1., i « 
(rather tiwih the ,4l level Applied to the short-term validities in 
Si^recSdlng^abie^beca^^ cons ider/^bly reduced sampl* "i** 

available f6r the Program Ppllpw-up Survey. In addition, 
for simplicity in, smnmarizihg 'the patterns of validity, the 
valuesi are shown only itor those post-program, outcome, vaxfiables 
fbt which at least; one. psycHoroetri ^ 
significant predictive validity. Thus, there are 13 criterion 
vi:"jibles shSwn in the table out of a total of 29 criterion 
vai-iables £rx>m tiie Followf-up Sur/ey that h^d been examined 
lii an original 7 x 29 matrix. (Obviously the 
significant r's presented here - i.e., J* T" ^jfi^J^VV?** 
-,ther« was a cTreater than chance number of significant r s 
present in that original matrix of 203 possible corrleations . ) 

'as with the^, short-term (program completion) criteria all 7 
measures of the psychometric battery possess significant 
validity 'format least some of the post-program criterion 
variables. The one outcome" variably for which all psychometric 
battery measures are predictively valid, is the status level 
of the job held 3 months after training. . Those who •co" ^. 
higher on the psychometric -measures at program entry ,( especially 
on ISe Job SnoSlidge, Job Holding Skills and Job peeking Skills 
Scales) are. more liKely'to occupy higher level jobs some 3 to 
4, months following high school conpletion. 

The t measures as a group are seen as most consistent in their 
predictive validity for: (1) post-program performance outcomes 
: of Job satisfaction (with 5 of the 7 having positive significant 
relationships) ; (2) whether or not the former ^.CJ^-P«*i5^P*;f:. 
goes on. for further formal school or enters some form of train- 
ino (for which 6 of the 7 measures show predictive validity) 
«SI 3? statSs level of the job that the individual would seek if 
;f or ihJ ?S? Zll ?r^sent job (fpr 6 of the 7 psychometric 
batterv mdasurei). ! 

Of sticial interest, among the predictive validities shown/ 
with the remaining jpb-orier.ted performance outcomes, are: • 
(1) the positive relationships between former PaF^J^^PfS^*.^ 
expressions of how well they know «ie job they would like to 
have, (Job Knowledge) and their scores at program entry on the 
tteee attitude scales of Vocational Attitudes, .Work Related 
Attltudei Inventory and Sex Stereotyping, (2) the tendency for 
those with more favorable attitude (WRAI, SS 
their first post-program job more quickly and ('3) a similar 



finding of predictive relfttionihips, between, attitudinal scales 
(VA and KRAI) and engaging in sone foxn of activity, with s 
"vocational promise** versus doing nothing (i.e. Current 
Activity Status) i 

For the out^comes bearing' on social adjustment, the two scales 
predictive'' of the importance of keeping out of trouble are. the 
attitudinal. measures of Job Holding-^ills (i.e. the degree 
of compliance with socially acceptably behaviors on a job) 
and Self Esteem. However, there is a jnegative; relationship 
f build between those who scored hi^vjsnJK, WRAI, JSS and SS 
and contributions to family finances /ihdic'ating that a 
favorable -score on those measures is/ associated with a lesser 
financial contribution. 



Similar to the findings for predictiveri^alidity of the 
psychometric battery using the,.--pj:X2a^j»*r\:ompletion criteria, 
the- overall results regarding the validity on those post- 
progr'azn criteria indicates, again, that^ tiie WRAI and SE — 
in that order — represent tlie two most yalid scales of the 
psychometric battery. 



Pr«dlctiv« V«liclit4«* For ti3rcho««txlc B«t^«ry N««tur«s Using 



1. ^ Itfi&sllMl 
Itt Jbb 



Job Sfttiflfacdflo 

6*. Xa SchooL or 

7. WihMtii^r 

, { 

8. Lfvtlcf Job 
(hole* (nact Jbb) 



9. Jbb Raoirlidei / 
ittMut Itofrai 



to IteUy XlMDC« 

12. IqiorUDCA oC 
KMftiiK qut oC 
.DcoubU 



Activity Status 
aO,37,38,39)^ 
iDfo Woifc or Sdxwl 
Hit timMoA.0t' 
School; lUU Um 
tt)tk or School 





.23 


.28 


.18 


tit ^ 
.24 


.16 


•15 






(-16)* 


-vl7 

\ 


■ 2 
(-.16)* 


'-»26 


->.17 






(-.13)* 

s 


* 


(-.13)* 


-»17 






{• 

-.17 












.14 




.13 • 


.19 




.16 


.20 


' *.19 




.10 

• 


.17 

• 


.16 
.11 


.12 


.13 


• 


•16 


.20 


.22 


.15 


.20 


.16 


.13 




• 


.14 

.Jl 




.12 






/ 






-.10 


'-ol2 








.10 


» 






.13 
















. .12 

; 






.10^ 









* All r'i .tlffJlfloBt at *• *05 <|onfi<l«c« liwtl OC bttt«r 

1 SBiplc;9i»nnBK£caBll-120toll-790 

2 r'i jwt *ort of «lini£ic«B« «t ,05 Iml; p - .06 



MEASURES APPLICATION 



The Study, aesign jand sequence of neasures^adininistration for 
thiir evjiliuation research was' develdped to meet tl^e need for 
a comprehensive set of procedures for all participating youth . 
.employment prograins.' These proceduries .specify time of 
administration for each of the following initrumejnts in the 
Standiardized Assessment Systems ' ^ ■ 

Individual Participant Profile (IPP) 
STEP. Reading Test :> • , 

t Pretest/PosttestrBattery ^ - 

a) Vocational Attitude 

b) ioh Knowledge 

c) Job Holding Skills 

. d) Work Relevant Attitudes 

e) Sex Stereotypes of Adult pccupations 

f ) Self Esteem 

g) Job Seeking Skills 

Prograiu Completion Svirvey 
Control Group Status Survey 

Program Follow-Up Survey C3 months and 8 months)- 
Control Group Follow-'Up Survey (3 months and 0 months) 

•'./■■ ^ . 

One of the xiK>re important features of. the study jd^sign and 
measures administration is the differentiation^ among subgroups 
of exeuninees with respect to the amount of t^e they participate 
in their respective programs. In the case of out-of -school 
programs (excepting summer-only programs), two critical time 
standards were defined — 10 program .days and 3 calendar months. 
Prograun participants were then classified in one of three time 
segments: ,(a) those who remain in the program for less than 
10 program days, (b) those who remain in the program for 10 or 
more prograxi^ days, but less tham 3 calendar months, and (c) 
those who remain in the program for ,3 or more calendar months. 
All of these groups (emd the co;itrol group (s) are administered 
the IPP (Participamt's Characteristics Section), STEP, and pro- 
test battery during the- first week of the program. Likewise, 
all jare administered the appropriate Follow-Up Survey 3 .and 8 
months after exit from the program. However « at the time of 
exit^ from the program, the administration design calls for 
progressively more comprehensive data collection from 
participants who remain* longer in the progreon^ Thusi for those 
who remain for less than 10 program days, only an IPP (Program 
Status Section) is completed.' For those who remain for at 
least 10 days 'but less t|i<^n 3 months, the posttest battery is 
8.dded to the IPP. Those who remain 3 or more calendar months 
ate administered thd Program Completion S\irvey in addition to 
the IPP and posttest battery.. The control groups, after a time 
ipteinral comparable to the length of the employment program, 
are administered the post-test battery and the Control Group 
Status Survey. 
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The entire administration sequence for out-of-school programs 
is shovm in the following. Honorarium .payments are optional 
for various participants and control subgroups, while mandatory 
in othei: cases. For participants,^. payment is optional in the 
situation where a. youth leaves the program before being post- 
tested. For controls, payment may be made for data collection 
at both the beginning and end of the program, if deemed necessary 
"by the program director. 

It should' also be noted that Although many programs have a 
fixed start and end date common to all participants, there are 
certain programs with differing start and/or end dates for 
individual participants — the so-called "rolling admission" 
and/or "rolling exit" programs. The above administration 
design in also applicable to these kinds of programs, simply 
by defining entry into an4 exit from programs o an' individual 
basis. The compArable preteist-posttest interval for control 
group data collection is typically set at the estimated mean 
jjrefeest-posttest interval for program participants. In 
sirbuatiohs where two or' more comparable control groups might 
be avairame reconsideration is given to the possibility of more 
than one pretestr-posttest integral for control . group data 
collection. " , 

The measures administration design for in-school and summer- 
only programs is completely analogous to that for out-of- 
school programs, except that the upper time standard is set 
at 60 program houris rather than at 3 calendar months. Thus, 
for in-school and summer-only programs, participants are 
categorized into the followirq three time segments: (a) those 
-who remain in the program less than 10 program days, (b) those 
who- remain in the {irogram at least 10 program days, but less ' 
than 60 program hours, and (c) those who remain in the program 
60 or more program houifs. The standard in terms of program 
hours (rather than calendar months) was adopted in recognition 
of the fact that in-school and summer-only programs are likely 
to vary considerably \with respect to the compression (in time) 
of their program services. Thus a standard in terms of 
program time, rather than calendar time, was judged to be 
more appropriate-. In 'Almost all ether respects, the 
administration design is analogous to the previously 
described design for oUt^of-school programs . The single 
exception, noted belowi the figure, is that YCD Demonstration 
Projects require administration of the posttest battery to 
program participants who remain in the program for 60 or more 
proTr=n hours, not 10 or more program days as do the other xn- 
schcjL programs. 

Th^ project and process information for year-round or in- 
school only programs is gathered fron project operators annually 
with an April 15 report date. For summer-only prefects, the 
report date is August 15. The project and process information 
material was implemented in fiscal 1980 so that summaries for 
earlier projects had to be . reconstructed where feasible and 
appropriate. Sponsoring organizations for multi-site projects 
!]r are responsible for collecting and validat^-ng this information. 
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S«qu«nc« of IntttuMnt Admlixittracion 
for In«*Sehool oxr, SuutrH)nly Progrtim 



During First 
y#€k of Prottraa 



At Exit From (or 
End of) Pro£r«n 



Thret Months 
After Exit 
From Progrsn 



Eight Months 
Af tsr Exit ^ 



Thoss who rsMin in 
progrsB f or Isss 
/lO ptogrsm dsy» 



•Psrticlpant^s 
than Chsrsctsristics<* 
(IPP) 
STEP 
Prstssts 



•Program Ststus- 

(IPP) 



•Program 

Follow-Up 
Survey 



•Program 

FoXlov-Up 
Survey 



Those vho remain in 
progrsm for 10 or more 
program daySt^but less 
than 60 program hours 



•Participant's 
Cha^ract eris t ics«» 
(IPP) 
STEP - 
Pretests 



•Program Status- 

(IPP)^ 
Posttests 



•Program 
FoUow-Up 
Survey 



•Program 

Follovmp 
Survey 



Those who remiin in 
program for 6b or 
more program hours 



•Participant's 
Characteristics* 

(IPP) 
STEP 



•Program Status* 
(IPP)^ 
Posttests 

Program Completion 



•Program 
Follov-Up 
Survey 



•Program 

Follow-Up 
Survey 



Control Group 



•Participant 'a 
Characteristics* 

(IPP) \ 
STEP 

Pretests 



•Posttests 

Control Group 

Status^ 

Survey 



•Control ' 
Group 
Follow-Up 
Survey 



•Control ^ 
Group, 
Follow-Up 
Survey 



If you ca& determine when a participant will leave the program, test In last 2 weeks 
/ prior to leavings If the youth leaves before testing has taken place, locate youth for 
/ testing and, if necessary, pay youth $5^00 to cocplete teating\(this includes both the 
/ Posttests and the Program Completion Survey, if required) • \^ 

^ate set in consultation with OTP or contractor staffs 

\ 

Pay $5^00 to each youth who completes the 3 month Follow-Up Survey • \^ 

^If necessary, you may pay control group youth for participating in testing* $5 •GO for 
Pretests, and $5^00 for Posttests and Control Group Status Survey • 



NOTE: YCD Demonstration Project requires post testing for any youth who has been in t\\it 
program for 60 or. more program hours • 



1 4' 
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S€qutnce of Inscrumtnr AdninlstrAtion for 
Out*-of ^School (Exc>pt Sug" ^^^*^] v ProgrtM 



During. First 
HMk of 
Program 



At Exit Fron 
(6r •nd of) 
. Progru 



ThT%% Months 
Af tsr Exit 
Fron Progrsa 



Eight Montbn^ 
Af tsr Exit 
From' progru 



Thoss vho rsmain 
in program for . 
lass than 10 
progr#m days 



•Participant's 
Charactaristics 
(IPP) 

•STEP 

•Prttcsts 



•Program - 
Stat\is-(IPP) 



•Program 

Fcllow-Up 
Survay. 



•Program 

Follow-Up 
Survay 



.1 



Tbbsa who, ramain 
in piogxram f or " 
10 ^cr rcra 
.prograir days, 
but lass than 
3 calandar 
months 



•Participant's 
Charactaristics 
.(IPP) 
• STEP 
•Pretasts 



•Program 
Status- (IPP) 
•Posttests 



•Program 

Follow«up 
Survey 



•Program 

-Follcw-up 
Survey 



Thooa who remain 
in program for 
3 or mora 
calandar months 



•Participant's 
Characteristics 

(IPP) 
^•STEP 
•Pretests 



•Program 

Statu8-CX|P) 
•Posttests 
•Program 

Completion 

Survey 



•Program 
Follow-Up 
Survey 



•Program 

Follow-Up 
Survey 



Control Group 



•Participant's 
<3iaracteristics 
(IPP) 
• STEP 
•Pretests 



•Posttests 
•Control Group 

Status 2 
Survey 



•Control Group 
Follow-Up 
Survey 



•Control Group 
Folloir-Up 
Survey 



^If you can determine when a participant will leave the program, test in last 
2 weeks prior to leavings If the youth leaves before testing has taken place, 
locate youth for testing and, if necessary, pay youth $5^00 to complete testing 
(this includes both^the Posttests and the Program Completion Survey, if required) 

2 

Date set in consultation with 

Pay $:»0' to each youth who completes the 3 month Follow-Up Survey • 



*Pay $10^ 30 to ech youth who completes the 8 month 

'if necessary, you may pay control group youth for participating in^.t€:S^ng. 
$5^00 for Pretests, and $5^00 for Posttescs and Control Group Status Sui 
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BASIC ANALYSIS PLAN 



I 



comprehensive evaluation of the ^uth demonstration programs 
must Or): have both 'a format ivjs and a aummative component, and 
(2) take advantage of the IqngitudinaL Mature of the design. 
• The, sraaraative component- is primarily .concerned with what works 
"besf and for whom while the formative component attempts to 
identify why particular programs work. Traditional statistical 
methods applied to data gathered in randomized experiments 
carried out undet laboratory conditions can provide information 
on both what and why. However, as one moves to field experiments, 
aontraditional and, innovative approaches to data' analyses 
must supplement \not replace) the traditional approaches. ■ 

In a literal sense there is no "sampling'* with respect to enrollees 
at a demonstration site since evaluation data are to be 
collected on the performance of all enroliees at a particular 
site.- The control group at a particular site, however, does 
represent a sample from a hypothetical population that is, 
hopefully, similar to 'the enrollees with respect to important 
background and, ability vauriables. To the extent that the 
enrollees (and the controls) are similar to other populations 
of intersst (e.g., other CETA qualified individuals), we can 
make generalizations concerning program effepts tp other employment 
and training contexts*- If the controls are fpxand to be quite 
different from the enrollees, any conclusions about treatment 
effects becomes quite tenuous regardless of the sophistication 
of the; statistical adjustment used to correcting for the pre- ^ 
existing differences. 

The smallest \init of analysis will be the enrollees within 
site. This will be the common unit of analysis when comparing 
participant and control groups within site. The results of . 
such comparisons make up the summative component of the 
evaluation model. When a particular demonstration program has 
a number of sites and one or more control groups, the repeated 
comparisons of treatment outcomes with control outcomes will 
.be considered independent replications within a program. In 
the latter stages of the analysis, data on sites nested within 
programs will be pooled across programs in an \effort to identify 
what program attributes (such as processes and/or personnel) 
influence; (1) psychometric battery test iscore gains, (2) scores 
on the Program Completion Survey (PCS) scales (3) positive 
program terminations, and (4) three month and eight month post 
program labor market per f ormamce . Figure 3. In more complex 
analysis, we will use both individual characteristics as well 
as characteristics of the sites in the same model. The 
characteristics of sites will come from a process survey. In a 
sense, there will be two units of analysis in such models — the 
individual and the program sites. Results based on the pooled 
data which includes both individual and site characteristics 
make up the formative component of the evaluation model. This 
type of analysis will tell the degree to which particular 
programs were effective. 
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The input description will include the following basic cross- 
tabs, which will provide a population description by site 
within a program* Frequencies and percentages responding to 
each item in the'IPP will be. tabulated within site by the 
following cross-classification: (1) Ethnic groups by treatment 
and control, (2) sex by treatment and control* (3) age groups 
and- (4) totals, i.e., simply breaking out each IPP item by 
treatment and controls When the Individual Participant 
Profile (IPP) response is on a continuous metric, means and 
standard deviations as well as the appropriate statistical 
tests will be presented in the tabled output j 

However, since findings of statistically significant differences 
may simply reflect large sample sizes rather than practical 
differences, all mean differences will be divided by the pooled 
standard deviations yielding an index of group differences in 
terms of standard deviation units. This vapproach allows one 
to compare more readily results from a large site with those 
from a small site. .In the social science literature a third 
o J alf a standard deviation, difference is -considered a • 
•medium" -effect while a one-fourth to one-third is considered 
a "small" effect (cf. , J. Cohen, 1968). 

The abqve cross-classifications provide sample descriptions by 
site within program as well as information as to what sites 
can be pooled within programs without raising questions of 
interpretation in subsequent statistical inference. Sites 
within programs which have 40 or less youths in either the 
program or control group will be considered candidates for 
pooling in subsequent analysis of covariance gain score 
analysis. 

The above analysis provides a description of the population 
of participants and controls by site within program. A 
description of the population of programs in terms of programmatic 
and/or process variables will also be carried out in an effort 
to (1) define program dimensions on which there is sufficient 
inter-program variability to be useful as explanatory variables 
in later structural or path analysis models and (2) provide a 
description of the population being served by selected categories 
of programs. That is, resulting tables would present not only 
the number of progjrams according to selected categories but^ 
also the demographic characteristics of the participants being 
served by each program category. Classifications of individuals 
being served by types of programs would include: ethnic group, 
sex, age groups, economic status and education levels. The 
individual characteristics will be taken from the IPP. 
Categories of programs will be defined by responses of program 
personnel to the standardized Project and Process Questionnaire. 
Program classification categories will include: 
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TIME PERIODS 



Pre-test Scores (SAB) 
Items 1-29 of IPP 



• Post-test Scores (SAQ) 

• I ten 30-A9 of IPP 

• Work Motivation 

• Social-Community 

Adjustment 

. Training Program 
Adjustment 

• - Positive Vocational 

Orientation 

. From PCS and CGSS 

• Employers and 

Counselors Ratings 

\ quantifiable Process 
Information (SPQ) 

• Cost Effectiveness 

Information 



T HREE MONTH FOU,OW-UP 

General Social and 
Vocational 
Adjustment 

On the Job Success 
and Satisfaction 

Job Search 
Motivation 

Job Planning 
Competency. 

Short Range Job 
Success 

Working vs. Not 
Working 9 

Salary Level 

Employer Rating 
Items and/or 
Scales 



EIGHT MONTH FOLtXW^I 

« G^eral Social: afij^:^ 
Vocational '.^ 
Adiustment 

. On the Job SuccesV^ 
and Satisfactions , 

• Job Search 

Motivation 

« Job Planning 
Competency 

« Short Range Job 
Success 

• Working vs« Not 

Working 

« Salary Level 

. Employer Rating 
Items and/or 
Scaled 



FIGURE 3 
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MIABI,RS AVAILABLE AT KACH POINT TN TTMK 



(Example of Cross <;iasilflcatlon for IFF Item 1) 



Male 



Fe^nale 



Minority 

Group 

Member 



Participant 



25 

(50Z) 



Konp articipant 20 

(40%) 



^5 



(50%) 
30 

(60^) 



Nonminority 

Group 

Member 



Participant 20 

(40%) 

Nonp articipant ' 10 

(20Z) 



15 ■ 
(60%) 

40 

(807.) 



Chi-square 



IerIc 



62 
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''Ar^Type-'^f'^ponTOring-Org a nizatiori" 



1. Prime sponsor ^ 

2. School or Educational Institution 

3. Kon-profit Community Based Organization (CBO) 

4. Profit Making Training Organizations ^ 

5. Other 

B. Service Patterns 

1* Primarily OJT or Work Experience 

2. Primarily Classroom Work Skill Development 

3. Primarily Classroon liaining in Employability 
Developmentr e.g., GED Attainment, Job Search 
Training, Life £>kill, etc. 

4. Service Mix 
^ — ^ 5. Ol^er 

C. Linkages 

1. Significant 

2. Moderate 

3. Limited 

D. Intensity of Program (Total Service Hours) 

1. IiOVJ 

2. Medium 

3. Hi^h 

E. Unit Costs - ' 

1. Low * 

2. Medium 

3. High 

Estimates of the reliability of the. measurements afforded by 
psychometric instrtanents are necessary for the appropriate 
interpretations of the "gain" scores. Reliability as defined 
here is an estimate of the relative stability ot the individuals' 
scores on two forms of the same test. This estimate is usually 
obtained by scoring separately two halves of the same test on . 
a given-sample of individuals. The two scores for each 
individual based on the separate halves provide two "independent" 
measures of his or her performance on the trait or attitude. 
The correlation between the two scores yields an index of the 
stability of the "halved" scores for this particular sample 
of individuals. This correlation between "halved" scores can 
be interpreted as an index of stability of the half scores 
but not the stability or reliability of scores based on the 
full length test. However, if we can assxane that the 
items that go into' each half are measuring the same trait and 
• one half -test is not more difficult than the other, then one 
can estimate what the reliability of the full length test is 
by using the Speatman-Brown Prophecy formula (Cronbachf 1970) . 
Ordinarily, if the half^-scoras are obtaini?d by simply scoring 
the odd and even items, the two scores should be sufficiently 
equivalent with respect to content and difficulty to meet the 
assumption of parallel measures of the same traits, and thus 
the aipplication of the Spearman-^Brown formula to estimate 
the reliability of the full test is justified. This type of 
O reliability is often referred to as a measure of internal 
r ER^C consistency reliability. ^Simila- to the correlation coeff icient r 's 
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yaTci«»~b»tween~xero-and lT07~where an observed reliability of 

1.0.%i6uld indicate that an individuals' score is coropletely 
stable from one paralle! test fofn to another. Conversely, 
if the obtained reliability is zero, knowledge of an individual's 
score on ^om A of the test would tell nothing about how he 
or she wuld, petf orm if given forni B, 

The extent of variation in xan--individualls_8core8 when 
Agoing f rok one test form to another is a measiire of the error 
variance in the observed neasurcanents ^ Thus, the reliability 
coefficient can be interpretied as a correlation coefficient,, 
squared or said differently ^and someVrtiat loosely) the per- 
centage of the observed variation between individual in the 
— sample that is true variationV When the reliability is equal , 
to one (i.O), then all tha observed variation among the 
individuals' scores are the result of "truec between 
individual varfation on the trait and thus there is no error 
of measurement present in the observed scores. 

* . ' ^ ' 

KtiDWiedge of the amount of true variance present in test 
scores (I.e., the degree of reliability) is particularly 
' relevant for interpreting the impact of an. intervention on gain 
scores. Gain scores are variations of simple difference 
scores (depending on how you compute them) and thus have 
components of measurement error from both the pretest and 
posttest. Thus, the difference score is less reliable than 
either the pre-test or the post-test scores. 

$ince the analysis «of covariance (ANCOVA) which will be 
described in detail later, use^ an adjusted difference score 
as a13iependent variable it would be useful to know if the 
' acceptance of the null hypothesis of no group differences is 
simply due to the unreliability of the measurement rather 
than the fact that the program did not work. 

Similarly adjusted difference scores can also be used as explanatory 
variables in various structural equation models (path models) . 
Knowledge of the test reliabilities will allow one to adjust 
parameters in such models and thus get an unbiased estimate 
of test score gain as an influence on later labor market 
performance. 

4 

In view of the abcve discussion, internal consistency reliability 
estimates will be obtained by site for treatment and control 
groups on all psychometric battery instruments pre and post. 
The reliabilities will be based on odd-even halves which have 
bee* J justed with the 5pearman-Brown Prophecy formula for full 
- test length. 



The basic analysis of gain scorss is concerriea with" program 
and control group comparisons with respect to test score gains. 
In lome programs^ there will be no control but there will be 
more them one treatment. In these cases, the treatments with 
programs vill be compared among themselves r assumii4g reasoncd^ly 
similar inputs and the usual statistical adjustmients to correct 
for pre-existing differences. In those cases where there is 
one site within a program having no control group, a within 
group gain score zmalysis will be carried out. In addition, 
possible cross program comparisons will be made with other 
programs having similar inputs. 

The^ analytical method to be used in the basic analysis of gain 
scores will include; (a) changes in means adjusted for initial 
status using the three different analytic models of; the 
analysis of variance of difference scores, the analysis of 
covariauice,^.and standardized gain score analysis, and (b) 
correlates of changes in individual rank order from pre to 
post-test, (i.e., .what are the correlates of gain within a 
program site?) Of particular interest here are the 
correlations of IPP responses and gain within a program. That 
is, what are the experiences and backgrounds of the people who 
show the greater^ gains? 



The analysis of covariance (ANCOVA) is often i^sed in quasi- 
experimental design situations to control for pre-existing / 
differences between comparison groups. In a non-longitudinal 
design appropriate Xv. iomizatioh procedures guarantees (in 
the long run) that the comparison groups will not differ in 
any systematic way before the intervention occurs. However, <^ 
in" a longitudinal study where the individuals are either not 
randomly assigned or are randomly assigned but "dropout" in 
a non-random manner then some type of design such as the 
ANCOVA must be used to correct for pre-existing differences 
between the groups who have both pre and post^test scores. 

The following figure shows a schematic of the isimplest ANCOVA model which 
could be used to estimate program impact on post-test scores 
while controlling for group differences on pre-test scores* 
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N Figure' S ] ^ 

Simple Analysis of Covariance Model for Estiaating Treatment Effects^ 



The one^-vay arrovs Indicate the causal schemed assumed In the' ANCOVA model. 
The double arrovs simply indicate a covrelntion and thus no causal direction* 
Posttest performance (X3) is assumed to be a function of (or due to); 
(1) initial performance as measured by the pretest (xi) and (2) group membership 

(xz)* The ti2 on the double headed arrow indicates the observed correlation 

J ... - • 

between treatment group menibinnhip and pretest icores is likely to be non-zero • 
If random assignment had taken place^ the expectation vould be that tn would 
indeed be zero. However,, because of either thej ^nability to randomly assign or 
because of selective dropping out of participants > the subset of the tojtal 
sample that has both pre and posttests will also be likely to have a non-zero 
correlation >^between group membership and pretest scores* Fo^^^ipcample, if the 
poorer performers at pretest time were more likely to drop out 6f the program 
then we would observe in the reduced sub-sample having both pretest and ' ^ 



^The above pictorial model can, of course, be defined* as a specf.al case of the 
general linear reg^essi^ model X3 ■ bai b32 X2 ^ fact, the actual 

computations will be carried out within the gcmeral linear model framework. 



post-test scores and a c>ositive non-*zero correlation between group 
memberships and pre- test scores* The interpretation of this 
positive correlation is^that you are more likely to have a 
higher pj:e-»test score if you are in the treatment group* The ' 
ANCOVA procedure attempts to control for such differences and 
thus make the two groups **eguivalent** at pre-*test time* 

In the simple ANCOVA model depicted the relative 
size of the partial regression weights, b32 and, hy^ (whc^ 
standardized ) indicates how important treatment group member- 
ship and initial status on the pre- test score is in determining 
the post-test score. The size of the iinstandardlzed partial 
regression weight, ^yi9 in relation to its standard error leads 
to a judgment about the presence or absence of a statistic^ally 
signif i<:ant treatment effect for group differences on pre-test 
scores. ^ The sign of b32* indicates/the direction of the effect. 
In this particulirr example, a finding of a significant positive " 
cb32 would be interpreted as evidence for the presence of a ^ 
trieatment related gaii\ on the post-test. A finding of a negative 
^32 suggests that the"" treatxAegit has a debilitating effect oh 
post- test gain when controlling for initial status* . Besides 
providing an estimate of the significance of the treatment effect 
the regression weight b32 (assvon^ng the above coding of treatment 
group membership, i.e., •^l** for treatment group, •^0'* for control, 
anpl the proper regression solution) yields an estimate -^f the 
average number of points gained by being a member of the 
treatment group. 



So much for the partial regression weight b32, what about the 
interpretation of the other partial regression weight, hy^ in 
figure 3? The partial regression weight hy^ is usually referred 
to as the pooled within regression weight. Inspection of the 
absolute size of b^^ can tell one who is doing the gaining. 
A finding of h-^^ less than 1.0 indicates -that., individuals with 
low pre-test scores gain the most. If b3i^ equals 1.0 then 
gains are "acrpss the board". When hy^ is greater than /I* 0, 
those with the high pre-test scores tend to gain the mopt* 

When'b32 is less than 1*0 the question arises, are the /low 
scoring individuals making the greater gains because the high 
scorers are •^bumping*' against a ceiling effect and/or jls it 
the result of the unreliability of the pre-test measurement* 
Assuming that the pre-test group means are at least or^e standard 
deviation below a "perfect" score then it may be helpful to 
correct hy^ for attenuation due to error of measurement in the 
pre-test* If the pretest mean is too close to th^ highest 
possible score (too close being arbitrarily defined as less them 
one standard deviation away) than the observation of |b3i being v 
less than 1*0 is more likely due to 'a ceiling effect rather than 
due to errors of measurement in the pre-test scores* 



These correctiona for attenuation ttmreliability of the pre- • 
teat) can.nake a difference in the interpretation of the 
importance of .the treatmeni effect, ' A somewhat betteiT under- ^ 
standiricj of the effect of^ correcting byi for unreliability on 
subsequwiVlireatment - group comparisons can be »een f rom 
exprSsing- the ANCOVA model shownv In it^s more ttaditional . . .. 

eguiational form, ' ^ . ^ 

• : b32 (x^2 ^ V ^31. <^tl "^cl> 

Equation (1) shows that- the estimlate of the • treatment effect 
(the partial regression weight, b32) can be expressed as the . 
difference between the two post-test keans minus the partial 
regressidn weight,- b^i, times the difference between the two 
pre-test means. " If we correct bai .for unreliability, by 
dividing it by the- estimated reliability of the pre-test 
which will certainly- be a number less than 1.0, then bji the 
cot^ected coefficient will be larger than b3i. Thus if the 
•pre-test and post-test mean for the treatment group, ^tl.^l - 
are O-arger than the respective control group pre and post-test 
means then the treatment effect bsj will usually be smaller if 
b<i is used in place of bai, ,If the treatment group-has a 
lower pre-test but a higher post-test mean /than the control 
group then the estimated trea-tment effect b32 will be larger if 
Mvf rather than b^i is used. Obviously, there 'are many other 
more cojnplicated patterns of relationships which could occur and 
about which no simple predictions can be made about the direction 
of the bias I if the uncorrected pooled' regression weight is .used. 



Both the coirrected and uncorrected ANCOVA model will be used in 
the standard analysis. , However, it| is necessary to use a more , 
completely specified ANCQVA model, than the simple model- used in ■ 
the above example. That is, a more satisfactory estimate of the 
treatment effect would be obtained if Additional control or 
patching variables are used in addition to the pretest scores. 

Vari^ables which mre likely to be used in the ANCOVA models to 
measure pre to post gains for the psychometric battery measures 
are (1) pretest scores, (2) ethnic group membership, (j) sex, 
(4) economic status, (5) previous employment experience, 
(6) reading performance, (7) educational level and (8) age. 
All of the above con-trol variables with the exception oi' • 
(1) and (6) are obtained from the IPP. The following figures show 
the type of output format that will be genefated by the ANCOVA 
model i long with two variations. The two variations include 
the t.. ctlysis of variance or difference scores v{ANOVA) and 
standardized gain se^>re analysis. Both of these additiona'l. 
methods can be sho'.^n to be special cases of equation (1) . 
That is, they dififer in that in general they wiU estin.ate a 
different value for b^^^ and thus b32 (the estimated, treatment 
effect) will also differ. 



VOCAT 

JOB KNOWL 
'SELF EST 
VRAI 

JOB HOLD 
JOB SEEK 
SEX STER 
STEP* 
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PARTICIPANT CROUP 



Measure 



Reliability 
Pre Post 



Pretest 
Mean Xi 
(Unadlustid) 



Post test 
Mean X2 
Unadlustid 



Posttest 
Mean V^z^ 
Adjusted^ 
for 
Covarlates 



where: 



* .Only obtain pretest mean, slgna and reliability. 
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CONTROL GROU? 



V 



1 / 



Measore 

VOC AT 
JOB KMOWL 
SELF 'EST 
VRAI 

JOB HdLD 
JOB SEEK 
SEX STER 
STEP* 



Reliability 
Pre Post 



' Pretest 
^Pnadlusted) 



. Posttest 
Mean Xz^ 
^ Unadjusted 



/ 



Posttest 

Mean X^2c 
Adjusted 

Covariates 



/ 



where: 



* Cily obtain pretest mean,' sigma and reliability. 



(ERIC 



'n 



Effect Size and Statistical Tests 



Covariance 



(ANOVA) 



Adjusted Rw Gain 
Effect - Effect 
Measure (xjp - xj^) (X^^^ - Xip) - i\ 



Fan Spread Hodel 

Standardized Significanc* 
Change Effects ANCOVA ANOVA 



VOC AT 
JOB KNOWL 
SELF EST 
VRAI 
JOB HOLD 
JOB SEEK 
SEX STER 
STEP* 



where: a. ■ 



+ a 



+ a 



«2, 



txi 



Xjt . 2j, 22» *3» ^i*. 



i.e.-, the partial correlation between a "duBtmy" 
coded treatment variable indicating treatment or 
control group membership And pretest score, 
holding constant the demographic 'control variables. 
The pretest correlation should be computed and 
compared with the posttest partial correlation. 



* Only obtain pretest mean, sigma and reliability. 
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The analysis of variance of difference scores (ANOVA) simply 
compares the mean difference between pre and post scores for 
the treatment group with the paralled quantity for the 
controls. Algebraically, this procedure is identical to a 
repeated measures design where the two testings provide the 
repeated measiires. Furthermore, this procedure is equivalent 
to using equation (1) with b^i - 1.0. Since this aPProach 
fixes b^i at 1.0 it implicitly assumes in its adjustment for 
pre-exiiting group differences that the gains are jcross the 
board. If there are "ceiling- effects and/or if the empirically 
derived ANCOVA estimate cf b3i is significantly less than 1.0 
when corrected for attenuation, one would have to question 
the use of the ANOVA procedure. If there are ceiling effects 
one would have to question th- use of either ANCOVA or ANOVA. 
If the empirically derived ANCOVA estimate of bai is considerabxy 
greater than 1.0 (i.e. high scoring individuals are gaining 
the most) one might also qiaestion the rationale for fixing 
it' at 1.0 in view of the empirical results. The only reason 

carry ina out the ANOVA computations would be if the sample 
'i'-e of the' treatment and/or control group was sufficiently 
'smlll to question the stability of the ANCOVA estimate of the 
pooled within group regression, weight b3i. in general, the 
ANCOVA estimate of h^i is usually close to one so these two 
methods often converge on the same results. 

The third estimate of treatment effect is also a special case 
of equation (1) where bgi is equal to the ratio of the pooled 
within group pre and posttest standard deviations. That is, 
b3i equals rfo/cTi where ^2 is the pooled posttest standard 
deviation and is the pooled pretest standard deviation. 

This adjustment is based on the assumption ^hat any group 

differences found at pretest time are the ^^^jlts of differentia*- 

growth rates. In practice the ANCOVA model adDustment index 

Li, is usually slightly less than 1.0 and thus implicitly 

aii^imes (and the validity of the model depends upon it) that 

observed differences at pretest time are relatively invariant 

over time in the absence of a formal treatment intervention. 

That is. the group growth rates are equal and stationary over 

the ti^4 S^e^val'^of interest. Campbell (^Jf 9) , ^^J^ests that 

if two groups start out at time 1 (present time) , those with 

the higher Lan gain at a greater rate than those with the 

lower mean in the absence of a treatment effect. Campbell calls . 

this tlfe interaction of selectio rand maturation. The different 

groups are members of different populations living 

environments. The different environments interact with differences 

S abm?rand create and maintain different levels of performance 

and different rates of growth. 
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A special case of this differential growth phenomenon is the 
so-called •'fan spread" model which postulates that increasing 
variability within group (as ineasxired by within group standard 
deviations) accompanies increasing mean differences wer time 
(Kenny, *I975)* The finding o£ increases in the group standard 
deviations from pretest to posttest suggest that the sc^called 
"f am spread effect" may be taking place and thus a reasonable 
estimate of h^i may well be the ratio of the pooled postest 
sta;^>dard deviation to the pooled pretest standard deviation* 
Then, of course , b^i would be greater than 1*0. 

An eclectic approach will be employed to estimete the 
treatment effect on test score gain^s ^nd '•flag" those out- 
comes when the above adjustment models lead to different 
conclusion". Further, investigations of the estimated group 
parameters; pre and post- test standard deviations, the size 
of b^if pre and post reliabilities, and possible ceiling 
effects will hopefully give some clues as to which model 
would appear to be more appropriate for each set of youth 
program data. 

The reader will note that in the preceding figures computational 
formulas are not the same as presented in equation (1). The 
computational formulas are however, mathematically 
equivalent to the simpler expressions already given for the 
various ways of adjusting for pre-existing differences. 

For ease of comparison across measures and programs the ANCOVA 
results are presented as differences between adjusted means 
in terms of standard deviation units. The ANOVA (analysis ^of 
variance of difference scores) will also be presented in terms 
of differences between adjusted means in standard deviation 
units. The standardized gain score analysis results are 
presented as two partial correlations. The first one, r^xlr is 
the partial correlation between the "dummy" coded treatment 
variable ("1" for treatment, "0" for control) and the pre-test 
score. The second correlation rtv2 is the parallel computation 
for the post-test score. If the pre-test partial correlation 
is smaller .than the post-test partial correlation then the 
treatment was beneficial. Th^ use of the partial correlation 
rather than the simple correlation is necessary in order to 
partial out the effects of the various self-selection causes 
which at leCdC partially describe ways in which the treatment 
and control groups may differ. _ For purposes of comparability 
the same control variables which were used in the ANCOVA model 
will also be used here. 

It is anticipated that the use of gain scores Chowever they 

may be adjusted for pre-existing differences) measured in 

terms of standard deviation units will make comparisons of 

cost ef .'^ectiveness ratios from one test to another or from 

one site to another more interpretable. The common approach 

to computing cost effectiveness ratios uses the raw score 

points which may not be comparable from program to program because 

of differences in heterogeneity of the participants on the 
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traits being measured. A gain of 5 raw score points might be 
a half standard deviation gain for a hornogenotis input sample 
at one program site but only a third of a standard deviation 
at a program site with a heterogenous population. 

' - < 

above three models (4 models if one includes ANCOVA 
corrected for attenuation as a separate model) have been 
presented in their simplest form for the purposes of exposition. 
The use of additional control variables in the models make 
the computations more complex but the above substantive con- 
clusions about the model similarities and differences remain. 
An additional point about one of the critical assumptions of 
ANCOVA will be made here. The ANCOVA model as used in this 
context assumes th?t the relationship between the post-test 
score and the pre-cest as well as any of the control variables 
is the same within both treatment and control groups. In 
somewhat more accurate terminology, the regression of this 
post- test on the • covariates (pre-test and other control variables) 
is assumed to be the same within the treatment ai.a control groups. 
This as9umpt;ion must hold or the partial regression weight 
associated with the pre-test 0^21^ °^ °^ other 
convariates will be biased and an incorrect adjustment for any 
pre-existing group difference will be made. Naturally, if 
an incorrect adjustment is made for pre-existing group differences, 
the estimate of the treatment effect will also be in error. 
For treatment control group comparisons the equality Of the 
regression of the post-test on the pre-test will be tested. 
" If a particular comparison shows both statistical and practical 
dof ferences between the regressions then we suggest the- approach 
• " due to Belson (1956). The Belson model uses an estimate of 
b-Ji , based on the control group data alone. Then predicted 
post-test scores are obtained for the treatment group using 
the control group regression parameters. These predicted 
treatment post-test scores are then compared with the actual 
treatment group post-test scores. If the actual post-test, 
mean for the treatment group is higher than is predicted using 
a irredictio'n equation based on control group data alone, then 
it is ass\amed that the treatment had a positive effect. This 
would appear to" be the simplest way out of the dilemma, when • 
nonparallel regressions are found when carrying out the group 
comparisons. 

The question of who gains is answered most easily within the 
multiple regression model. Using data on the treatment group 
only, step-wise multiple regressions will be, carried out where 
the pre-test scores are forced to enter first and the remaining 
dem -:'.iphic control variables (age, sex, ethnic group, economic 
statt i, reading scores,- previous employment experience and ^ ^ 
educational level) will be "stepped in" according to how well 
they contribute to the prediction of the post-test scores. 
This will be carried oat for eadh of the SAS instruments. • 
Those demographic variables that significantly add to the 
predictibn of post-test scores after controlling for the pre^r- 
test score will define a profile of the type of individuals 
who "gain" the most from the treatmertt. The similarities 
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and differences among the types of individuals vho show the 
greater gains can then be contrasted across programs. It 
well may be that the same type of individuals show the greater 
gain regardless of the type of inteinrention. 

Analysis using the scale scores and other item information 
from the program completion survey (PCS), the^^control group 
status survey (C6SS) , and the three and eight month follow-up 
8ur;veys will also be carried out* ..More specifically, 
treatment and controls will be compared with respect 
to the following scales work motivation, social-community 
adjustment, training progrspn adjustment, and positive vocational 
orientation/ The analysis will be carried out vithin the 
stemdard ANCOVA format using the above list of demographisc 
as control variables (covariates) « *A parallel ANCOVA analysis 
Vfill be carried out for the scales in the three and eight 
month follow-up. 

An analysis of the relationship of the gain scores on the tests 
to the above 'PCS and f ollow-*up scales should also be carried 
out within the treatment group. This cari be best accomplished 
by regressing each of the PCS and 1follow*-up scales, one at a 
time, on a pre-»test score and then adding the post^^test 
information. The increment in r2 (the squared multiple 
correlation) due to the post-*test indicates the effect of test 
score gain on the particular PCS s^ale or follpw-up scale. 

Similar analysis can be done within the treatment group by 
utilizing as dependent vari2Ut>ledthe scales derived from both 
the counselor rating form atnd the scale from the work supervisors 
rating form^ In addition to examining the relationship of : gain 
in test scores to the counselor and supervisor gratings, the 
dexnpgraphic control yariables noted atbpve also Will be 
correlated with .the rati.ngs • 

The standard analysis will also include the. prediction of 
positive vs. negative termination (the dependent variadble) 
from the pret^%st euid the demographic control variables. This 
type of analysis should help identify the characteristic (at 
entry) of participants who are not likely to achieve positive 
terminations. In addition, this analysis will furnish evidence 
for the predictive validity of the psychometric battery. 

The above analysis will generate a wealth of quantitative 
information for each program site, yet unless some means of ' 
summarization is carried out, the significance of the numerical 
output will be lost to the reader. It is suggested that 
certain '^signs of merit" based on summaries of the data be 
constructed at the program level. Although these signs of 
merit will be constructed from the output nvmibers obtained 
at each program, they need not be identified with the program 
name. It would seem reason?J)le to group the programs according 
to the classifications outlined earlier and confrast the signs 
of merit across these progrsun classif^ications. 
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One sign of merit would be sijniply the percentage of times the 
treatment group at a program site denionstratea a greater 
adjusted gain using tha ANCOVA adjustment than the control 
group for the seven meastire SAS battery. A program site whose 
treatment group showed a. greater gain than the control . group 
on all seven measure's would be assigned a sign of T.^rit of 
100%. A site where the treatment group did better than the 
control group on four of the seven measures would be assigned 
a sign' of merit of 57% etc. The use of percentages allows for 
comparisons across programs having different numbers cf sites. 



A second more rigorous sign of merit would be the percentage 
of times a program site achieves a gain of a quarter of a • 
standard deviation or more. This more rigorous criteria may 
yield an index with too little between program variation to 
be useful or it may be so highly correlated with the first 
index that it can be dropped. It is further suggested that 
hoc I these sians of merit be computed for; (1) the psychometric 
battery (2) the PCS scale profiles, and (3) the scales on the three 
and eight month followup* The two signs of merit can be compared 
for the program categories defined by, (1) type of sponsoring 
organization (2) service patterns (3) delivery environment, - 
and (4) program intensity. This summary will provide some 
preliminary results in an easily interpreted format. 
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I , Appendix 1 

I ■ Coitnponents of the 

Standardized Assessment 
1 System 



Some of the iristruments in the SAS are copyrighted • Permission 
has been gr^n* -^.d fo^ their use only in the SAS. The components 
of the SAS are presented. to provide an understanding of the 
system. At this time, they may not be utilized without 
approval. Requests should be directed to the Office of Youth 
Programs, U.S. Department of Labor. 
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Definitions for the individual Participant Pioflle 
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itfmCIPANrS KRSONAL DAIA: Personal data recorded at 
,ne time the'youtt^ makes ap plication to ihe program. 

1. ETS 1.5. MO.: A$$}oned by ETS. Rrst two digits designate 
tt^e y6uth project. Next two digits designate tt^e project 
site or location. Next six digits Identify on individual 
youtfi. 

2. NAME: Legal name. 

3. ADDRESS: Location at wtiict^ tt^e youtt^ resides. 

4. TELEPHONE: Telephone number at wtilch \he youttt con 

* be reached vi/tien not at a program site. 

8. SOCIAL SECURITY NO.: Number on youtti's "Social Secu- 

* rltvl account r\o. cord" or ottier document (W-2 Form). 

6. DATE OF ilRTH: Exact montfi, day, and year of birth. 

7. SEX: Designation of mole or female. 



PARHCIFANTS characteristics: Personal Information re- 
corded at the time the youth mokes application to the 
program. ' 

S. EUDCAnON STATUS: Circle only one category which best 
describes the youth's education status. 

1 ~H.S. Studen'h enter grade: Youth is enrolled in a soc- 

ondoiy school (including junior and senior high 
school or equivalent) or is between school termsond 
intends to r^tum to school, or Is enrolled in elemerv 
toiy school; enterhlghest school grade compleled. 

2 -H.S. Dropout; enter grade: Youth is not attending 

any school and has not received a high school di- 
ploma or GED; enter highest s.;hool^ra^- 
completed. 1 - — " 

3 -GED: Youth has received a GED certificate but has 

not attended any post-secondaiy vtx:ational. tech- 
nical, or academic school. 

4 «H S Graduate: Youth has received a high school di- 

ploma but has not attended any post-secondary 
vocational, technical, or academic school. 
5-Fott-Hlgh School Attendee: Youth has received a 
H.S. diploma or GED certificate and is attending or 
has attended a post-secondoiy vocational, techni- 
cal, or academic school. 

9. ECONOMIC STATUS: Circle only one category which best 
describes the youth's family income. 

1 -6mII/70% LLSIL: Youth is a member of o family which 

has on annual family Income which, in relation to 
family size and location, does not exceed (a) the 
most recently established poverty levels determined 
in obcordonce v/ith criteria established by the Of- 
fice of Management and Budget or (b) 70% of the 
lower living standard income level, whichever Is 
greater. 

2 -74^% LISIU Youth is a member of o family which 

has on annual family income v^^lch. In relation to 
family size and location. Is 71-86% of the lower living 
standard Income level. 

O ' ^ 
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3 -66*100% ILSIL: Youth Is a member of a family which 

has on onniidl family income which. In relation to 
family size pnd location, is 86-100% of the lower liv- 
ing storiddrd Income level. 

4 --Abow^100% LLSIL: Youth Is a member of a family 

which has on annual family income which. In rela-' 
t!on to family size and location. Is above 100% of the 
lower living standard income level. 

10. FUlUe ASSISTANCE STATUS: Circle all applicable cate- 
gories which describe public assistance status of the 
youth or the youth's family. 

1 — AFDC: The youth or the^youth's family is receiving irv. 

come on \ io r- ier P5yrne nts pursuant to a State plan 
approved under the Social Security Act, Title iV (Aid 
to Families v^^th Dependent Children, or If the appli- 
cant Is 0 foster child [family of one] on behalf of 
v^^om governmental payments ore mode). 

2 -FubllcAtsl»tance-SSI: The youth or the youth's family 

Is receiving supplemental lnc6ir,e or money pay- 
ments pursuant to o State plan approved underthe 
Social Security Act, Title XVI (Supplemental Security 
for the Aged, Blind, or Disabled), of pursuant to the 
|ndochlr>b Migration and Assistance Act of 1975, 
Public Low 94-23.) 

3 -Ottier Cash FubWc Awlstance: The youth or youth's 
family is receiving State or local cosh assistance 
based on need. | 

11/ ECONOMICAUY DISADVANTAGED: A youth who con be 
described by any of the following categories: (a) a 
member of a family v^lch receives public assistance; 
(b) 0 member of a family vMo%e incorjne during the 
previous six months, on on annualized basis, v^s such 
, that the family would hove qualified for public ossist- 
/ once if it hod applied for such assistance and /or it does 
' n6t exceed the OMB poverty level o) 70% of the lov^r 
living standard income levei; (c) a foster child on vy/hose 
behalf Stole or local government payments ore mode; 
(d) 0 client of a sheltered workshop; (e) d handlcapper< 
individual v^th a family income of 100% or less of the 
loWer living standard income level: (0 o person confined 
to dn Institution or facility providing, 24-hour support 
such ds in prison or hospital; (g) a roguior out-potlent of 
0 mental hospital, rehabilitation facility .or similar 
institution. 

12 RACE/ETHNIC GROUF: Circle only or>e category which 
* best describes the youth's roqe, ethnic group. (NOTE: 
The category v^ich most closel^reflects the individual s 
recognition in his/her community Should be used for 
youth who ore of mixed racial and efhrficoriglns.) * , 
' 1 -White (not Hispanic): Ayouth having origins in any of 
the original peoples of Europe. North Africa, or the 
Middle East. 

2 --Block (not Hispanic): A youth having origins in any of 

the block racial groups of Africa. 

3 -Hispanic: A youth of Mexican, Puerto Ricon, Cuban, 

Central or South American, or other Spanish culture 
or origin (including Spain), regardless of race. . 
/\ -American Indian/Alaskan Native: A youth having 
origins in any of the original peoples of North Amer- 
ico, and who maintains cultural identification In 
tribal affiliation /community recognition. 
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5 -Aiian/PoeNlf: lilondtr: Ayouth hovinq origins In any 
of the originQl peoptos of the Far EaitrSouffieo$t 
Asla^he Indloh . subcontinent (i.e.. India, Pakistan. 
Bongjodesh^ Lonko, Nepal, SIkklm. and Bhutan), 
or tl>e* PocWc^lilaQds. This area (ricfudes, for ex- 
ample. ChirHj. Japor^KQiea, the Philippine Islands. 
ondSarnbo. 

13. UMiffO^ENOUSH STEAKING ABIllT^>ie^V^^ 

tarvguoo*!* not English qnd his/her aplilty to^ix^rntxiun 
cafe In Er>gllsh is a job handicap. 

./^•^ 14. FAMILY $tWU$:Rr$tente/thenunnber of household nnenn- 
bers. then circle only Ihe one category which best de- 
scribes the youth's family status. 

Number' of Houtehold Members: Enter total number of 
persons IMng Jn youth's household. ^ 

1 -Family Head: Youtt\ Is a member of a.famllynof two or 
more persons and considered to be the head of -the 

' family by rriembefs of the family. 

2 -Family Member: Youth Isa'jriemberofafamllycftwo 
or more persons and Is not considered to be the 

\ ^ / head of the family by members of the family. 

3 -Non-Dependent IndMdudl: Youth Is either (a) living 
. with his/her family, 18 or older, receiving less than 

50% malnterionce from the family, and not the 
head of family t^ie spouse of the head of the fami- 
ly, or (b) 14 or pkler end not living with his or her fami- 
ly, or (c) a foster child on behalf of whom Stafe or lo- 
■ col government payments are made. Such youth 
should be considered as families of one for deter- 
mining Economically Disadvantaged, Under- 
employed and Lower LMog-Standard Income Level 
status: 

15. MARITAL STATUS: Circle onlyone category which best de- 
scribes the youth's marital status. 

16. CHILDRIEN: The youth has responsibility for support otone 
prnnor^ dependent children; enter exact number of de- 
perklent children. 

1 7. VETERAN GROUP: A veteran is a person who (a) served on 
active duty for a period of more than 1 80 days, and was 
discharged, separated, or released therefrom \A^th oth- 
er than a dishonorable discharge, or (b) was discharged 
or released from active duty for a service connected dls- 
abllltyi The term **actlve duty" (or "active mllltCiy, nav- 
al, or air service") means full-time duty In the Armed 
Forces, other than duty for training In the rese'.ves or Na- 
tion al Guard. Any period of duty for framing In the re- 
j^erves or National Guard, including authorzed travel, 
during which an indKfidual was disabled fron\ a disease 
or injury Incurred or aggravated In the line of duty, is 
considered •'active duty". Circle all applicable cate- 
gories which describe the youth's veteran status. 

1 -Veteran: Avouth who meets the definition of veteran 
contained In the introduction to this Item. 

' 2 —Vietnam Era: A veteran 34 years of age and under 
wHo served on active duty betv/een August 5, 1 964, 
^ end May 7, 1976,pnd discharged or released within 
s ^ 4 years preceding application to the program. 

3— Speciol: A veteran who served In indochino or 
Korea, Including the waters adjacent thereto, be- 
* t^Moen August 5, 1964, and May ^, 1975, inclusive, 
t end who received other than, a dishonorable 

discharge. ' * • • 



•4 rSptclol Disabled: A youth who served In^e Armed 
forces and who y^s dlschafged<>r/eleasecl there- 
from with ofier thamo cJi^iono^able discharge and 
who has beeh given Ojcllsabttity rating of 30tJefcen' 
turn or more, ora ^^rson whose.djsdhtarge or release 
from active duty^was for disability Incurred or aggra- 
vated In theilfie of duty. \ • . ' ' v 

5 -Net oy^on; A youth" whb meets none <rf the 
^^^apovtfcategofies. \ * . - ^ 

16. MIGRAm/SEASONAL FARM FAMILY MEMIERrAy^^ 

Is o^fnember of aTamlly which had one or more-persons 
\^o, during the preceding 12 montffs, v«>rked at least 
25 days In farm work' and worked less* tt\an 1 50 corts^cu- 
' )\yo days at^ any one establishment, mciude both* rnlgrp-^ 
toryf and nonmigrotory farmvJorkers, but do not Include* 
, supervisors or nonmigrotory lnd(ykiuals wtib are full-time 
students or farmworkers who are n6t*"seasonai"ids de? ^ 
fined In tha preceding sentence.', . ^ ' . * 

19. HANDIjCAFKD: Ayouth who {jasfa phystegi or'mfentdl dis- 
ability which, at the tinhe of ehrollrrienti^ohstltutes a, 
substantial barrier to employmeiat. and the lnd]y|?iuql Is ' 
unemployed-OS a result of this disability. 

20. OFI:ENDER: A youfh wno has been subject.to any stage of 
the crimlnal Justice process, for*whom empbynvent and 
tralnlnj) sendees mg>' bp beneficial or who requlf€>s ps- 
sis'tqncaln overcoming artificial borriers'tb employment 
resulting from a record of crrest or correction. ' - . 

21. LABOR FORCE SlATtlS: Circle onV one category v^lch 
best describes the youth's labor force status. ' 

1 -Ih-Schopk A youth who ;a) Is currently enrolled full- 
-time In, and attending, a secondary, trade, techni- 
cal, vpcdtlonoi school or community college or Is 
scheduled to attend full-time the next regularly 
scheduled quarter or semester of any .of these 
«ctiools^orJbj has not completed high school and Is 
scheduled to attend a program leading to a secon- 

^dary school diplompi or Its equivalent. 

2 -Undt^mptoyed: A youth who- Is (a) working part- 

time but is seeking full-time work, or^b) >/jfklng full- 
time but receiving wages, not In excess of the higher 
of either the OMB poverty level or 70% of the lower 
living standard Income level, 

3 - Unemployed: A youth v^o is without a Job for at 

least 7 consecutive days prior to application. The 
youth shall be considered as being without a Job If, 
during those 7 consecutive days he/she fulfilled any 
of the following four conditions: (a) worked no more 
than 10 hour* and earned no more than JS30.00 and 
was seeking and available for work; (b) was a client 
of a sh altered workshop; or a prisoner eligible for, or 
, In, a work release program; or institutionalized In' a 
hospital or similar Institution; (c) was a. person 18 
years of ag.e or older, whose family would be eligible 
to receive public assistance if both parents were not 
presenf In the home; or (d) was a veteran who has 
not obtain^ permanent unsubsldlzed-empioy- 
^ ment since being released from active duty, f 

4-OtheK A youth who meets rone of the above 
categories. 




22. UNEMPLOYMENT INSURANCE CLAIMANT: A youth \A/ho has 
filed a claim and has been determined monetarily ell- 
Qlble for benefit fl>ayments under one or more State or 
Federal unemployment Insurance programs, and who 
has not exhausted benefit rights or vCtiose benefit year 
has not ended. 

23. * PREVIOUS CEIA PARTICIPANT: A youth who has at any 
« r time received employment and training services and 

- any related wages or pllowances by participating \n a 
program ffnonced locally undor the Comprehensive 
Employment and Training Act (CETA). \ 

24. STEP- READING SCORE: The number of correct answers on 
' " th§ 2CHtem STEP readjng test. 

LAST JOB: ^ 

25. Last worked: The oract month c^d year when youth left 
* last job held. ' " 

24, Hourt Worked Per Week: The number of hours usually 
worked per week on the youth's last job. 

27. Job Title: Write In the name of the job .which best de- 
scribes the v/ori< performed by the youth. 

28. Hourly .WOge: The exact houriy wage earned on last job 
\A/hen lost wori<ed (see Q. 25). 

29. Subsidized Wage: Last job held by the youth was a jm- 
porary position which was part of another GET.'' 
program. 

/\ / 



PROGRAM STATUS: Information and data on the youth's par- 
ticipation In and termination from the program. ^ 



3a ENTRY DATE:-The gxact month, day and year a youth first 
received serviceifrom the program. 

31. PROGRAM SERVICE GROUP: Definitions for these cate- 
gories will b3 determined by ETS. (Do not circle any num- 
ber In Item 31.) 

1 -Participant Gfoup 1 

2 -Participant Group 2 

3 -Participant Group 3 

4 -Control Group 1 - ^ ^ ' 
^ 5 -Control Group Z 

32 RECfiVED ACADEMIC CREDIT: The youth is awarded H.S. 
credit for special work or other program activities 

^ adoptixi by the program. 

33 RECEIVED HIGH SCHOOL DIPLOMA: Youth received H.S. 

* Diploma in the course of ,porticlpating in the demon- 
stration project. ' 

34. RECEIVED GED CERTIFICATION: Youth received GED Certi- 

* licatlon In the course of participating In the demonstra- 
tion project. 

35. RECEIVED OCCUPATIONAL CERTIFICATE: Youth earned 
special certification for attaining special ; skills meet- 
ing standards set by a State or other agency or organl- 
zatlOQ Independent of the^program. 



OTHER PROGRAM PROGRESS: Definitions for these categories 

will be determined by ETS. {Do not make entries In items 36. 
; 37. and-38.) 

36. 

37. 
. .38. 

TERMINATION ^ ' 

59. Termination Date: Exact month, day and year that a ' 

youth was terminated from participation In the 

program. 

40. Total Progrom Hour$: Total number of hours a youth ac- 
tually attended program activities. 

41. Total Progyam Wages: Total wages and/or allowances 
received while enrolled in the program. 

42. LABOR ;FORCE STATUS: Circle only one categor/ which, 
best describes the youth's labor force status at the time 
of his/her termination from the program. * 

/ 1 -Employed: A Vou*h who is (a) wortJng part-time and 
V, Is not seeking full-time work, or (b) working full-time 
and receiving wages in excess of the higher of either 
the OMB poverty level or 70%* of thejowpr living 
standard income level. 

2 - Underemployed: A youth who is (a) woridng part- 

time but :s seeking full-time work, or (b) wort<ing full- 
time but receiving wages not in excess of the higher 
of eitner the. OMB poverty level or 70% of the lower 
living standard income levels 

3 -ynemployed: A ycjTi v/ho has not been placed- 

in or obtained an in^ul3i oized job. and has not 
worked for more than ^ n^jrs per week earning no 
more than $30.00 per week and is seeking and avail- 
able for work. " 

4 -In School: A youth who (a) is currently enrolled full- 

tirr.eln. and attending, a secjDndary, trade, techni- 
cal, vocational school or community college, or is 
' neduled to«attend full-time the next regulariy 
scheduled quarter or semester of ^.ly of these 
schools.^or (bj has not completed high school ond is 
^ scheduled to otter :.i a program leading to a secon- 
dary school diplcma or its equivalent. 

5 -Other: A youth who is working, but meets none of the 

requirements for the above categories. 

6 -Status Unknown: A youth who has left the program 

and cannot be located- (this person should also be 
listed under category 9. item 49 under Non-Positive 
Termination), 

POSITIVE TERMINATION 

43. Entered UnsubsldUtjd Employment: Youth has entered 
employment in the privole or public sector and re.ceives 
wages which are not subsidized under CETA or some 
other government progiam. 

44. Entry Date: Exact month, day and year that a youth en- 
tered unsubsidized employment. 

45. Job Tltie: Write in the name of the job which best de- 
scribes the work performed by the youth. 

46. Houriy Woge: The exact hourly wage earned by the 
youth on his unsubsidized job. 



83 



47. Houn Wofktd^ Ptr Wttk: The number of hours usually 
wofked per week on the youth's unsubsldlzed job. 

48. OTHER POSITIVE TERMINAHON: Circle onSy one cateooiy 
which best de^rlbes the positive termination of youth 
who has not er^tered unsubsidlzed empioyrhent. 

1 — Entefed full-|lme academic or vocotlofKil school 

Z -Enleied a non-CEIA funded Manpower Progrorn 

3 — IntertWe Trai^tfer: Youth has entered another CETA 

program, j 

4 -Completed progrom bb)ectlve not involving un- 

subsidized employment 

5 —Entered Armed Forces 

./ 



HON POSmVE TERMIMATION 

49. Reason tor Termination: dfcle only one category which 
best describes the norvpoirttive termination of youth. 

1 -law off 

2 -Health 

3 - Pregnancy 

4 - Family care 

5 — Tronspoitotlon jp^roblems 

6 -Moved from area 

7 -Refused to coritiriue 

8 -Administrative Mparottoti 

9 -Cannot locate 
0 —Other non-poslthfe 



\ 
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Step 



[Before you give the STEP Test, you should have the participants fill out 
the Information In the top left section of the test book.] 

C 

"Please print your name on the first line. Then fill in the name 
of your project or school and the name of the city and state in 
which your project or school is located. If you are in school 
now, check whether you are a junior or a senior. Please fill in ^ 
your age and check male or female. Last, write in today s date. 



"Read the directions on the front cover of the, test book while I read 
them aloud.** 



Directions ' 

Each ruestion in this test is followed by four suggested answers. 

Read each question and decide which one of the four suggested answers is 

Then circle the letter next to the answer you have chosen. 



"Are there any questions?" 



"Read the paragraph and answer the two sample questions below by circling the letter next to the 
answer you have chosen." ^ 



[Allow a few minutes to read the paragraph and complete the two samples*] 

The Herring Gull is especially good at seizing food from other birds. It is about 
twenty.four inches long, and it is the gull that you most often see at the beach. 
It wiU often chase a bird that is carrying a fish or a stolen egg home to eat. The 
Herring Gull keeps attacking the other bird until it drops the egg or the fish. Of 
course the egg will Jbrcak if it hits the ground. But Herring Gulls are so fast and 
agile they can sometimes catch an egg in mid-air. 

SAMPLE 1 SAMPLE 2 

Which of the following is the best title for 
this passage? 

How Herring Gulls Get rood 

B) Catching Eggs 

C) How Herring Gulls Fly Faster Than 

Other Birds 

D) Eating Habits of Birds 



How long is a Herring Gull? 

A) - 12 inches 

B) 18 inches 
24 inches 

D) 32 inches 



*'In SAMPLE 1» the correct answer Is A because the passage Is about 
how Herring Gulls get food. Therefoi^e, A is circled." 

"In SAMPLE 2, the correct answer is C because the passage states that 
the Herring Gull is twenty-four inches long. Therefore, C is circled." 

"Are there any questions?" 

"You will have 15 minutes to answer the questions. Turn to the first 
question. Begin." 



[During the administration, move quietly about the room to see that each person 
is markivig his answers by circling a letter in the test booklet.] 

[At the end of 15 minutes, say:] 

"STOP! Even if you have not finished you must stop and lay down your 
pencil." 
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ETS ID No. 
Name 



Last 

Project or School , 
City 



First 



.State . 



Jr. 



Sr. 



Grade (if in school) 
Age Male □ Female □ 



<Date. 




Step 



Directions 

Each question in this test is followed by four suggested answers. 

Read each question and decide which one of the four suggested -answers is best. 

Then circle nhe letter next to -the answer you have chosen. 



SAMPLE 



Read the paragraph and afiswer the two sample questions below by circling the letter next to the 
answer you have chosen. 

The Herring Gall is especially good at seizing food from other birds. It is about 
^ twenty-four inches long, and it is the gull that you most often see at the beach. 
It will often -chase a bird that is carrying a fish, or a stolen egg home to eat. The 
Herring Gull keeps attacking tliC other bird until it .irops the egg or the fish. Of 
course the egg will break if it hits the ground. But Herring Gulls are so fast and 
agile they can sometimes catch an egg in mid-air. 



SAMPLE 1 

Which of the following is the best title for 
this passage? 

ffi) How Herring Gulls Get Food 
^ Catching Eggs 

C) How Herring GuUs Fly Faster Than 

Other Birds 

D) Eating Habits of Birds 



SAMPLE 2 

How long is a Herring Gull? 
A) 12 inches 



B) 



IP. inches 
'2^ inches 
32 inches 



copyright ©X979.by Educational Ttfting Strvlca. All rSflhts rttarvad. 



Questiom l-S 

From loaves lying ready on the table, each 
person cut a thick slice of bread. This he placed in 
front of him to serve as a plate, or "trencher." 
Everyone reachf^d into the serving dishes with 
both hands and carried the food, sauce and all, as 
best he could to his trencher. 

^Do not dip your fingers into the sauce 
deeper than the second joint," Lady Alice told 
Robert ^len he first came to the castle. "That - 
would not oe good manners." 

Dogs prowled about the tables, waiting 
hungrily for bits of food and bones to be thrown 
to them. They often fought over (he scraps. 

The floor of the great hall was covered with 
rushes — reeds cut from the river bank in spring, 
and spread our lo lessen the chill of thr cold 
stone. At first this carpeting was soft and 
fragrant. But it soon -became foul with bits 
bone and food. 



2. 



4. 



What did the people in this passage use 
as plates? 

A) Silver 

B) China 

C) Bread 

D) Napkins 

The floor of the great hall was made of 

A) stone 

B) wood 

C) dirt 

D) mud 

Rushes were put on the floor in order to 

A) cover up the used trenchers 

B) make tl i carpet look pretty 

C) make the floor feel warmer 

D) keep the dogs away 

The story takes place in a 
A) restaurant 



B) 
C) 
D) 



castle 

school 

church 



5. The story says that the dogs were 




Go on to next page ^ 
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Page.3L 



(5) 



(10) 



Questions 6*11 

Chocolate comes^rom a white bean produced 
by the cacao tree. Thr Aztec Indians first made 
chocqlate by whipping ground, roasted cacao 
beans in hot water and then adding vanillc»rgrccn 
pepper, and spices. Later the Spanish found that 
^by adding sugar to the ground cacao beans they 
could make a delicious new drink. This new drink 
was to become very popular among the kings of 
Europe. Chocolate was sometimes drunk by sick 
people as a tonic . Special chocolate houses in 
Spain, France, Italy, Holland, and England 
served this new treat to fashionable customers. 
Now chocolate is a flavor we enjoy in^ candy, 
cake, ice cream, and milk shakes. 

What is the best title for this story? 

A) ' How the Spanish Discovered Chocolate 

B) The History of Chocolate 

C) Flavors of Candy and Ice Cream 

D) How to Grow Cacao Trees 

What did the Aztec Indi::ns put in chocolate? 

A) Milk 

B) Sugar 

C) Whipped cream 

D) Green pepper 

The kings of Europe drank chocolate with 

A) sugar 

B) spices 

C) green pepper 

D) vanilla 

Tonic in line 10 means 
A) medicine 



B) 
C) 
D) 



soda 
treat 
candy 



10. The first people in ti-^ passage to use chocolate 
were the 

A) Spanish 

B) French 

C) English 

D) Aztecs 

11. Fashionable in line 12 means 

A) sick 

B) intelligent 

C) stylish . ^ 

D) young 



Questions 1244 

Early people had little reason for measuring the 
-..A^'arca of land. They did- not have permanent homes 
Mnd were nomadic. In la^^r^ycars, people began to 
stay in one place on land that they owned. 
Therefore, they needed some kind of description 
or measure of land. 

Seeds were the earliest measures of this kind 
and the amount of land which a pven amount of 
seed would plant became a unit of measure.^ 

A common unit of land measurement today is 
an acre. At first an acre represented the amount, 
of land a farmer could plow with his oxen in one 
day. However, this was never a very precise way 
of measuring the land. An acre still means a 
certain amount of land in one country and a 
different amount in other countries. 

12. The passage is mostly about 

A) how land is measured 

B) how people lived long ago 

C) why seeds were used to measure land 

D) why farmers m^d oxen to plow 

13. Nomadic in line 3 means 

A) farming without modem tools 

B) moving from place to place 

C) living in caves 

D) fighting with other groups of people 

14. Why was the use of oxen not a very good way to 
measure land?' 

,A) Different people could plow different 
amounts of land in a day. 

B) Some, people planted more seeds than 

other people. 

C) People did not know how to farm 

efficiently. 

D) People did not care how much land they 

owned. 



Go on to next page ► 



;erlc 



8'J 



Questions 1S>20 



15. 



16. 



17. 



As a young society woman Mary Cassatt might 
have done the conventional things, but she was 
different. She had a passion for drawing and 
painting; she was determined to be an artist, and a 
(5) good end, regardless of ii^t family and friends 
thought. 

After several years of studying in Italy, 
Spain, and Belgium she ended her art pflgrimage 
by settling in Paris. There she was soon attracted 

(10) to the work of the artist Degas. His work is known 
here in America chiefly through copies of his drawings 
of ballet gids. In a way she became his disciple . 
She was willing to accept his suggestions and 
criticisms as she would not accept anyone else's. 

(IS) More than any other artist of modem times, 
Mary Cassatt made herself famous by painting 
the single thome of mother and child. 



The main purpose of this story is to discuss 
Mary Cassatt's 

A) career 

B) family 
Q friends 
D) travels 

Mary Cassatt is most famous for paintings 
she did of 

A) ballet dancers 

B) scenery in fzns 

C) scenery in America 

D) women arJ their children 

The word conventional in line 2 means 
A) 



B) 
Q 
D) 



humble 
artistic 
miraculous 
usual 



18. The word pilgrimage in line 8 means 

A) journey 

B) friendship \ 
. C) purchase 

D) masterpiece 

19. A disciple O'ne 12) is a person who 

A) nurses another back to health 

B) follows th? teachings of another 

C) inspires someone to do great works 

D) receives money from someone who has 

died 

20. It can be concluded that Mary Cassatt believed 
that Degas 

A) was a difficult person to understand 

B) painted like artists she knew in America 

C) wanted to go to America 

D) had. good ideas about painting 



STOP! If you finish before time is called, you may check your work. 



Y4fP2f ppi 4 qtn. 30 
Prmttd in 



. -» -y. 



•• • ; 't. ■ -. 



V 



YOUTH PROJECTS 



ADMNISTRATOR'S MANUAL 



Educational Testing Service 
Princeton, New Jersey 



■ .-4 



dl 



NOTE TO THE ADMINISTRATOR 

The set of measures In this booklet are to be prerented to participants 
enrolled in your program and to a control (or similarly matched) groupjv^f 
people not enrolled in your program. The booklet includes seven (7) Separate 
measures. The measures are to be administered in the order in which they 
appear in the bdoklet. The instrument designations and order presentation 
are: 

Vocational Attitude Scale (VA) - 30 items 

Job Knowledge (JK) - -33 items 

Job Holding Skills (JHS) - 11 items 

Work Relevant Attitudes Inventory GTOAI) - 16 items 

Job Seeking Skills (JSS) - 17 items 

Sex Stereotypes of Adult Occupations (SSAO) - 21 items 

V 

Self Esteem (SE) - 15 items 

These measures are to be administered in an informal manner — unhurried 
and in a conversational tone. The group of participtots should be ito larger 
than 15 to 20 persons. A short break may be taken at the end of section 4 if 
^leeded.'^'^^l seven sections are to b6 administered at one testing session. 

The directions for each section and all items are to be read aloud by 
the administrator. All answers are to be marked in the test booklets , them- 

> 

selves. Pencils should be used to mark responses in the booklets. 
Distribute the booklets and pencils. 
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lADMIKISTRATOR^S DlifflCTIONSI 

Say: We appreciate the. fact that you're willing to help, us. You may be 

able ^-o pick'' up some Information" about yourself by trying out different , 
kinds of questions and 'statements you'll see In this booklet. We'd . 
like you to answer all the questions but you don't* have to answer any 
question you feel we li^ve no right to ask. If you think that the 
correct answer for a quefstlon Is not given, leave It blank. If you rvC 
not sure of an answer. It's OK to guess. 

Now, please print your name on the front cover of the booklet. Then 
fill In the name of your project or school and the name of the city 
and state In which your project or school Is located. If you are la 
high school now, please check If you are a junior or a senior. If ^ 
you are not a junior or a senior, leave It blank. Please fill In your 
age and check male or female. Last, write In today's date. ^ 




/ 

/ 

\ 

/ 

/■■ / . 

(administrator's DIRECTIONS! 
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Vocational Attitude Scale (VA) 



§AY:y Okay, now turn to page 1. Look at the directions in the box at the top 
of the page, . Read them silently' while I read them out loud« 



For each statement /if you agree of mostly agree, mark the box 
under the letter T. If you \disagree or mostly disagree, .marK 
the box under the letter F. . * * / 



VA 



Look at number 1. I often daydreara about what I want to be, but I really 

/ 

haven't chosen a line of work yet. 

If you agree or mostly agree with that statement, mark the , box under the 

letter T. If you'disjagree or mostly disagree;rwith the statement y-mark 

the box under the letter ¥. * ' * 

o 

Look at number 2. Everyone seems to tell me something different; i^s a 
result I don't know which kind of work ±c choose. 
Check T if you agree.... F if you disagree. 



NOTE TO THE ADMINISTRATOR / ' ^ ' 

Continue to^ read the rest of the statements in. the same manner. Check to 

« 

see that the respondents are following the directions. When the group has. 
completed number 30, go on to the next section. 
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i ADMtNISTRAIOR'S DIRECTIONS 



Self Esteem- (SE) 



SAY: Turn to page 35. Look at the directions in the box at the top of- 
the page. Read them silently while I read_them out loud. - 



The pictures that follow show everyday kinds of situations in which a person might be involved. 
Mark the space next to the way that tells best how you would feel if you were the person in that 



SE 



scene. 



I 



Cloprrifht 1978 by EdttCfttiocMl TcstUit S 



NOTE "^0 THE ATMINISTRATOR 
When there is a balloon in 



picture, read the quotations in the balloon. 



SAY: Number 1. If you were 



the person getting the diploma h6w would you feel? 



The diploma's iibt goin^ to do anything to l^e^po someone, like me. 
I might get .e- little better job with the diploma. 
I could really have it made with a diploma. 

Mark the answer that tells best how you would feel. 



NOTE TO THE ADMINISTRATOR 



Continue reading the rest <)f the ^tems in a similar manner. 



/ 
/ 



-1- 



/ 



/ For each statement, if you agree or mostly agree, mark the box 
' under the letter T. If you disagree or mosilly disagree, mark 
the^box under the letter J. ' ' 



VA 




T F ' 1 ; ■ . 

I I I I 1. ■ I often daydream about what I-want~to-be-,— but--I- — 
, reallv haven't. Chosen a line of work yet. 

' ' ■ .• ■ • 

Everyone seems to tell me something, different; as 
a ifesult I don'r know which kind of work to choose, 

□ □ 3. It^s probably just/as easy to be. successful in one 
occupation as it is in another. 

T . F ^ I / 

-O CD ^- /^t doesn't matter which job you choose as long as / 
it pays well. . i 



T F 



5. I plan to follow the line of worksjny parents 
suggest. 



-T F 

n n 



6. You should , decide for yourself what kind of work 
to do. ^ 



T F 
□ □ 



T F 

a □ 



7. There are so many -things to consider in choosing 
an occupation, it ±s hard co make a decision. 



8. The best thing to do is to try out several jobs, 
and then -choose /the one you like best. / 



From, the Career Maturity InyeltoW Attitude Scale, Counseling Form B-1 
devised by. John 0. Crites. i^odified and reproduced permission of 'the 
publisher, "CTB/McGraw-Hill, Del Monte Research Park, Monterey, CA 93940, 
Copyright 1978 by McGraw-Hil^, Inc. All Rights Reserved. Printed 
in the U.S.A. 
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-2- 

T F 

C3 □ 9. There is no point .deciding on a job when the future 
^ is so uncertain, \ 

\ 

T F " 

Q Q 10. There is only one occupation for each person. 



T F 

□ O 11. Your parents probably know better than anybody else 
which occupation you should enter. 



T F 

□ □12. When it comes to choosing a job, I'll make up my 
own mind. 



T F 

□ □ 13. I keep changing my occupational choice. 



T F ^ 
rn I — 1 14. As fair as choosing an occupation is concerned, 
something will come along sooner or later. 



T F 

n I — I 15. i«m not going to worry about choosing an occupation 
until I'm out of school. \ t> 



T F 

O □ 16. You get intS an occupation mostly by chance. 
\ I F 

\ Q □ 17. You can't go very far wrong by following your 
parents' advice about which job to choose. 



T F 

O O 18. Choosing an occupation is something you have- to do 
on your own. 

T F 

□ □ 19. I'd rather work than play. 



T F 

rn n 20. I don't know whether my future occupation will 
allow me to be the kind of person I want to be. 



0 
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T F 

1 1 I I 21. It*s who you know, not whr.t you know, that's 
important in a job. - 



T F . 
I I \ I 22. You shouldn't worry abo^jtrcKooslitg a job since you 
don't, have anything tpsay about it anyway^. 



T F 

I I I I 23. I dion't wantmy>^rehts to tell which occujpation 
I should jBh^se. 



T F 

1 I I I 24. If , someone would tell me which occupation tis^ enter, 
I would feel much better. 



T F 

□ □ 25. I don't know whether my occupational plans are 
realistic. 



T F 

□ □ 26* I have so many interests it's hard to choose any 
one occupation. 



T F 

□ n, 27. You should choose a job in which yoju can someday 
become famous. 



n □ 28. Entering one job is about the same as entering 
another. 



T F 

I — I j~| 29. . Parents usually can choose the most appropriate jobs 
for their children. 



T F 



□ □ 30. I feel that I should do what my parents want me to 
do. 



/ 



PLEASE STOP HERE. 
WAIT TO BE TOLD HOW TO DO THE NEXT GROUP OF QUESTIONS. 



o S8 
ERIC 
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I AP yiNISTEATOR'S DIRECTIONS ! 



Job Knowledge (JK) 



SAY: Now please turn to page 4* Look at the\directicns in the box at the 
top of the page. Read them silently while I read them out loud. 



•/ 



In these exercises you'll see pictures of different jobs and'the name of each job. Next to each 
picture are questions about the job, like how much that job pays or what kind of work you do pn 
that job. 

Please answer the questions about each job. For each question, mark the space next to the 
answer that you think is the right one. 



Copyright ^ 1978 by Educational Testing Service: 



SAY: Page 4 shows a picture of a cashier. 

Number \. Where would you work on this job most of the time? 
In a factory on an assembly line. 

c 

In the kitcheif of a "restaurant. 

In ^ store.- 

In your own home. 

Mark the' answer that you think is the right one. 



NOTE TO T.iE ADMINISTRATOR t 

Continue reading the rest of the questions including the names of the jobs 
and the responses. ' 

t 

The tools that are pictured in several of the items are not to be read by 
the administrator. 



9 



In these exercises you'll sec pictures of different jobs and the name of each job. Next to each 
picture are questions about the job, like how much that job pays or what kind of work you do on 
thatjob« 

Please answer the questions about each job. For each question, mark the space next to the 
answer that you think is the right one. 



JK 
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J- 

Where would you work on this job most of the time? 



CS> in a factory on the assembly line 

In the kitchen of a restaurant 
CZI) In a store 
dl^ In your own home 



2- 

What kind of work do you think you would do on 
this job? I 

Design and repair cash registers 

Check out goods^for customers and collect money 

Operate a copying machine and keep financial 
records 

CII>Help people borrow money when they need it 



3. 



When are you supposed to do the work on this job? 

CZD Mostly at night from midnight to 8 o'clockin 
the morning 

Might be any hours— day or night, weekdays 
or weekends 

C::>Only weekends— all day Friday, Saturday and 
Sunday 

d^Only during the day from Monday to Friday 



iERIC , 
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^^^^^^^ 

SCHOOL TEACHER 



A. 

"When are yousuppQsed to do the work on this job? 

CD Monday to Friday, from about 8 o'clock in the; 
mcming to 4 o'clock in the afternoon 

CD Mostly at night from about midnight to 8 o'clock, 
in the morning for 5 days a week 



CD Any kind of hours day or night from Monday 
to Friday 

CD Only at nights and on weekends 



5. ' , . 

About how much would you get paid when you start 
on this job full-time? 

CD $6.75 to $7.50 an hour 

CD$1.25to$1.65anhour . 

CD $2.00 to 2.65 an hour 

CD $3.75 to $4.25 an hour 



6. 

How much schooling do you think you'd need to get 
this job? 

CD Grade school only 

CD A high school diploma only 

CD A college degree 

CD No special schooling 



f ERIC 
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7- - - 

Where would you work on this job most of the time? 
CD In your own home r ^ — — - 

In a garage or service station 

d> In a f actory on flggpmhljLlim* — 



CID Outdoors, where new houses are being built 



\ 



8. 

Which one of these^ ;ools would you use in this kind 
of work? 



OP 



CD 




9. 

When are you supposed to do the work on this job? 



dl? Any hours of the day or night 

dp Mostly during the day from about 8 o'clock in 
the morning to 4 o'clock in the afternoon 

CD Mostly at night from about midnight to 8 o'clock 
in the morning " 

CZ>Only on weekends— Friday, Saturday and Sunday 



."Sis 
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10. 

When are you supposed to do the work on this job? 

CD Only during the day— from about 8 o*clock 
' ^in.the.mprnmgto^o'cl^^ 

OOnly at night— from about midnight to 8 o'clock 
-r in^he^moHiing ^— 



<0 Mighfbe any days or almost any hours during 
the day or night ^ 

CD Every Friday, Saturday and Sunday only— either 
during the day or at night 



11. 

What kind of work do you think yoii would do on 
thisjpb? 

Q) Decide what medicine ajsick person should 
/.take 

CD Heip a sick person by feeding him 

CD 0o>lood tests to tell what is ^y^ong with a 
sickperson 

C^iGive examinations to tell if somewie is sick 



12. 

About how much would you get paid when you 
start on this job full-time? 



CD $4.25 to $4.75 an hour 
CD More than $5.00 an hour 
CD $2.90 to $3.50 an hour 
CD $1 .85 to $2.25 an hour 




13, 

What kind of work do you think you would do on 
this job?' 

CD Give medicine to sick people 



CP Teach people how to read and write 
Ci:>tajk with people about their problems 
I> Arrest people who commit crimes 



14. 

About how much would you get paid when you 
^star^n this job fuU-time? 

CD $6jOO to $7.00 an hour 

O $2.25 to $2.75 an hour 

CD Over $8.00 ^^n hour 

CD S4i6o to $4.75 an hour ^ \ 



15. 

How much schooling do you think you'd need to 
get this job? 



CD No special schooling 
CD A college degree 
CD A trade school certificate 
CD Grade school only 
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16. 

When are you supposed to do the work on 
this job? 

C35 Only during the day from about 8 o'clock 
in the m bfning to about 5 o'clock in the. 
^ . afternoon ^ 

CZi> Could be any days or any hours during 
the day or nigHt 

en:) Whatever hours you feel like working 

Only at nights from about midnight to 
8 o*clock m the morning 



17* 

How much schooling do you think you'd need to 
get this job? 

Q High schoo^diploma 
CP Grade school only 
CD Trade school certificate 
CD No speci al schooling 



1.8. 

Where would you work on this job most of 
the time? 

CD In a factory on an assembly line 
CD Ik your own home 
CD Outdoors on a farm ^ 
CD Outdoors in a city 
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19. 

About how much would you get paid when you 
start on this job full-time?' ' > 

CD $3, 75 to $H.25 an hour 



Cr?$l,30to$L65anhour 
$2,20 to $2,50 an hour 
CD $8,50 to $9,25 an hour 



20. — . 

What kind of work do you think you would do on 
this job? 

CD Keep records of all letters received in a 
.post office 

CD Sell stamps in a post office 

CD Sort letters and (feliver them to people 



jCDg ix mail^soitin g machines when they 
break down 



21. ^ - 

When are you supposed to do the work on 
this job? 

CD Only at night— from about midnight to 
.8 o'clock in the morning 

CZS Might be any day or any hours during 
thedayornight . 

CD Mostly during the week from about 

8 o'clock in the morning to 5 o'clock in 
~" — the afternoon — ~ 

CD Every RFday, Saturday, and Sunday 
only 



ios 



to ' 




'22. ^ ' ' 

Which one of these tools would you use in this " 
kind of work? % - ' , 



CD 



••V 



CD 



23. 

How much schooling do you think you'd need 
to get this job? 

CZ> No special schooling 

CD At least a college degree and special 
schooling 

CD Only a grade school diploma 

CD A trade school certificate and training 
on the job 

• /- 



• 24. 

About how much would you get paid when you 
start on this job full-time? 

Cp) $6.00 to $6.75 an hoiir 

$2.60 to $3.50 an hour ^ 

CD $7.90 to $1 1 .50 an hour 

CD $4.00 to $5.25 an hour 
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TEL£PHONE OPERATOR 



25i 

Where would you work on this job tpost of 
the time? ' / 



CD In a factory, on an assembly, line 
. CD In a shpp, like a hardware store 

» 

\v In your own home 

CD In a building, like an oiTice building 



26. 

About how much would you get paid when you 
start on this job full-time? 

C3> $4;85 $5.25 an hour 

Ski 

C±>$1.75 to $2.25 an hour 
d:? $3.25 to $4.00 an hour 
C->$5.90 to $6.75 an hour ' 



27. 

- What kind of work do you think you would do 
on this job? ^_ - 

CD ?^Jx broken telephones 

CD He!p people make telephone calls 

^ 

Cl^Send telephone bills to people 
CZ? Help design neW telephones 



ERIC 
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28. 

Which one of these tools would you use in this 
kind of work? \ 



CD 




29. , 

How much schooling do you think you'd need 
to get this job? 

CI> A high school diploma only 

CD A college degree and special training 

O Trade school certificate and special 
training 

CD Grade school only 



30. 

When are you supposed to do the work on 
this job? ^ ~ 

CD Only from about 8 o'clock in the morning 
to 5 o'clock in the afternoon 

CD Almost any hours during the night or day 

CD Nights only from midnight to 8 o'clock 
in the morning 

CD Only on weekends— Friday, Saturday 
and Sunday 




31. 

When are you supposed to do the work on 
this job? 

CZ> Nights only from about midnight to 
8 o'clock in the morning 

CI> Weekends only — Friday, Saturday and 
Sunday 

CD Whatever hours you feel like working 

CD Mostly during the day from about 
8 o'clock in the morning to 5 o'clock in 
the afternoon 



32. 

About how much would you get paid when 
you start on this job full-time? 

CD More than $5.00 an hour 

CD $1 .75 to $2.25 an hour 

CD $l'-Op to $1 .40 an hour 

CD $2.75 to $3. 25 an hour 



33. 

How much schooling do you think you'd need 
to get thisjob? 

CD High school diploma 

CD Trade school certificate 

CD College degree 

CD No special schooling* 



PLEASE STOP HERE. 
WAIT TO BE TOLD HOW TO DO THE NEXT GROUP OF QUESTIONS. 
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iia)MimsTRATOR's directions! 



Job Holding Skills (JHS) 



SAY: Turn to page 15. Look at the directions in the box at the top of the 
page. Read them silently while I read them out loud. 



The questions that follow are to find out how much you know about how people should act on a 
job*— and what ^ou might do on a job wiien certain things happen . 



JHS 
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SAY: Number 1. If you feel too sick to go to work one day, would you call 
and let the boss know? 

I wouldn't bother - it wouldn't make any difference to the boss. 
I might call if I happened to think of it. 
I would always call - otherwise the boss would get sore. 



Mark the answer that tells what you would do. 



NOTE TO THE ADMINISTRATCR ~ — 

Where there is a balloon in a pictu-'^ read the quotations in the balloon. 

Continue reading the rest of the items in the same manner. 
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The questions that follow are to find out how much you know about how people should act on a 
job— and what you might do on a job when certain things happen. 



JHS 
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1. 

If you feel too sick to go to work one day, would you 
call and let the boss know? 

CD I wouldn't bother — it wouldn't make any 
difference to the boss. 

CD I might call if I happened to think of it. 

CD I would always call— otherwise the boss 
would get sore. 



2. 

If you're short of money before payday each week, 
would you borrow what you need from somebody 
at work? , 

CD I would do that anytime I felt like it. 
CD I might do that sometimes. 

i 

CD I would never try to do that at work. 




3. 

What would you say to a boss who said this to you? 

CD Sorry, I'll try to get here on time from now on. 

CD It's tough for me to make it here on time but 
nitiy. 

CD I do my work— what's the difference if I'm late. 



ERLC 
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How do you feel about this person who's dressed in a 
'sloppy v»y at work?- 

0>lt doesn't inatter how you dress as long as you 
do your job. 

O You should dress sharper than ffie rest so you 
stand out and are noticed. 

CD You should dress about the same way as the 
other people and look neat. 




5. 

How do you feel about placing a few bets each 
day at work? 

CD I wouldn't do that— most bosses wouldn't 
like it. 

CZ> There's nothing wrong with it— a boss 
wouldn't mind. 

- 0> I might do that sometimes— but I wouldn't 
overdo it. 



When someone who's the boss gives you a lot of 
orders about what to do, how do you feel? 

<0 It rubs me the wrong way to take orders and I • 
usually letJheJbpss.know it. 

0> I don't like taking orders, but I'll do it if the 
boss doesn't push it too far. 

<0 1 usually don't mind. The boss's job is to give 
orders. 
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7- . ^ 

How dp you feel about someone taking a drink this 
way on the job? 

CZ> It's okay, if you try not to get caught too often, 

CZ> You should never do it— a boss wouldn't lUce it. 

CZ> It's your own business when you take a dnnk— 
most bosses wouldn't mind. . 



iTOSTWIWUNf 




8. ^ 

What would you think if someone working next to you 
said this? ^ 

CD That person better lay off or I'll hit 'cm right now. 

CD I'm going to quit this job if the people here 
bug me. 

CD I won't look for trouble^ t'll just ignore it. 



9. 



If you get a paycheck and you think the amount is 
wrong what would you do?. 

CDLet it go. It doesn't pay to make a fiiss. 

CD Go tell the boss he or she's a thief. 

CD Tell the person who gives out the pay that you 
think there^s a mistaJce. 



V 
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10. 

What would you say if the boss asked you this? 

C:5 Not me, I only work if I'm paid to dp it. 

<0 1 would do it if I could get some extra time off. 

<0 It's too much trouble for me to work after 
regular hours. 



11. 

If you finish the work that's given to you in the 
morning and the boss doesn't tell you what to do 
the rest of the day— what would you do? 

CZ:> Just knock off and relax. It's best to work onlv 
when you're told what to do. 

CD Look for something else that needs doing on the 
job or maybe help jsoriiebody else with their work. 

CD Try to look like I'm -working at something so the 
boss won't think I'm goofin g off. 




PLEASE STOP H^RE! 
WAIT TO BE TOLD HOW TO DO THE NEXJ GROUP OF QUESTIONS. 



Il5 



yi 

I ADMINISTRATOR'S DIRECTIONS! Wo.rk Relevant Attitudes Inventory 



SAY: Turn to page 19. Look at the directions in the box at the top of tl 
P^S^* Read th^ silently while I read them out loud. 



The statements that follow have to do with wa^s you feel about 
. yourself , about-other^people arid getting along with them. For 
e ach st atement mark the b ox ne xt to the way that tells how you 
feel. * ^ ' , 



WRAI 



SAY: Number 1. You feel tlxat you have little influence over the things 
that happen-to^^ou. 

Strongly, agree« 

Somewhat agree. ^ _ ^ 

Somewhat disagree. 
Strongly disagree. 



Mark the way that tells how you feel. 



NOTE TO THE ADMINISTRATOR 

Continue reading the rest of the items in the same manner. 
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The statements that follow have to do with ways you feel about 
ypurseif , about other people and getting along with them. For 
each Statement mark the box next to ^4ic way that tells how you 
fieei. 



WRAI 



1. You feel that you have little influence over the things 
that hapipen to you. ^ ~ ; " ~ / ^ 

□ strongly agree 

□ somewhat agree 

□ somewhat disagree 

□ strongly disagree 



2. You don^f get much fun out of life, 

□ strongly agree 
O somewhat a|rce 

□ somewhat disagree 

□ strongly disagree 



3. Becoming a success is mainiy a matter of luck; hard work 
doesn^t help' very muchv 



(3 strongly agree 

□ ^SMewhat agree 
Q somew|iat disagree 

□ , St rongl^N disagree 



Modlfiftd arid reprinted by. permission of the author 
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4. You feel that you are as capable and smart as most people* 

0 strongly agree 
rn somewhat agree 
CD somewhat disagree 

1 I strongly disagree ^ 



5. The wise person lives for today and .lets tomorrow take 
care pf^itself 

. I* 

D . strongly agree 

O somewhat agree 
□ somewhat disagree 
O strongly disagree 



6. It is hard to get ahead without breaking the law now and 
then. 

n strongly agree ■ 
I I somewhat agree 
O som<ewhat disagree 

n strongly disagree • ' 



?• Most people cannot be trusted. 

□ strongly agree 

n somewhat agree 

rri somewhat disagree 

I I strongly disagree 



8. Most bosses have it in for you and give you. a hard tine. 

I I strongly agree 

I I somewhat agree ^ ' " 

n somewhat disagree X ^ P 

□ strongly disagree ^ ^ 



Most work is dull and boriUig* 

□ strongly agree 
n somewhat agree 
ri somewhat disagree 

□ strongly disagree 



You feel happy. ^ 
n almost , always 



usually 
PI - sometimes « 
□ almost never 



/ 



Teachers have had it In for you and have given you a hard 
time* 

Q almost always »^ 
Ci usually 
n sometimes 
□ almost never 



You feel that you are a failure. 

□ almost always 

□ usually 

□ sometimes 
n almost never 

During your spare time, you haye sooiethlng to do that you 
like doing. 

□ almost always , ^ 

□ usually • 

P sometimes 

□ almost never -^-xu 
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Tou get even with people vfao wrong you- as soon as you can. 

O almost always 
□[ usually 
n sometimes 



□ almost never "^^^V>^ 



Would you aay that your chances of becoming a respe^cted and 
law abiding aember of your community are: ' 

0 excellent 

. 1 I reasonably good 

1 I not very good 
O very unlikely 



How many enemies do you feel you have: 

rn a great many ^ '"^ 

0 some 
m a few 

1 } almost none 




PLEASE STOP HERE. 
WAIT TO BE TOLD HOW TO DO THE NEXT GROUP OF QUESTI(»IS. 

120. ■ 
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1| ADMINISTRATOR'S DIRECTIONS! ^ Job Seeking Skills (JSS) 

SAY: Turn to page 23. Look at the directions in the *ox at the top of 
tihe page. Read them silently wHile'I read them oiit loud. 



The questions that follow ate tojnlout hpwmuch.ypu know about.tookingjfor jobs. For each 
quciiioh, mark the space next to the answer that you think is the right one. 



JSS 



Cop^fht C 1978 by Edticttkmtl Tettliit Strvkc. 

SAY: Number 1. If you go to the State Employment Service to help you 
find a job - what would they charge if they found a job for you? 

They would charge one week' s pay. 

They would charge whatever you can afford. : 
It doesn't cost you anything. 

They would charge half a week's pay. - - - — 

s 

Mark the answer that you think is^ljicyright one. 



NOTE TO THE ADMINISTRATOR ' <. 

Continue to read the rest of the items in the same manner. 
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The queropns that follow are to find oui iKm muc^ jrcu know about looking for jobs. For each 
que$TOn» mark the space next to the answer that you ttiinK is the right one. 



CopyrighsO t978byEdttcttioc«}Tcttifif Service. 




1. ^ 

If you go to the State Employment Service to heji^ • 
you find a jobp-what would they charge if they . 
, found ajob for you? r y 

CD They would charge one week's pay. 

C25They would charge whatever you can afford. 

'CD It doesn't cost you anything. 

CD They would charge half of a week's pay/ 



2. . 

On which day are there more '*hdp wanted" ads • 
, for jobs in the newspaper? . 

CD On Sunday 

CD On Saturday 

CD It's the^me any day 

CD On Tuesday 

NOTE TO THE ADMINISTRATOR 

Iq tha following sets 6f questions » do not read material in v^nt ads or 
any content of application blanks. 



SAY: Beginning with que8tion*3 we're going to look kt some job "want ads — 
like the kind that you see in the newspaper when someone wants to hire 
people for jobs. Read the first want ad on your own and then 1*11 read 
the questions to you that ask about what's In t;he want ad* 



NOTE TO THE ADMINISTRATOR 

Allow approximately 30 seconds for reading of the ad. 



4? , 
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MONDAY THROUGH WOAV . 

Minimum 1-2 Yf$ Exp 
GOOD STARtiNG SALARY 

EXCELLENT COMPANY BENEFITS 
IMMEDIATE 20% DISCCUNT 
ON AIL FASHIONABLE MDSE ^ 
Fof iopo'ntment call: 

OR 5:1000, EXT 477 
'.Worthman Smith 

Washinflton St. N.Y.C 



3. 

How much experience would you need for this job? 
CI^ You don't need any experience. 
CI) At least one or two years. 
CZ^Less than a year. 
CD At least five years' experience. 



. What kind of benefits do you get on this job? 
CD You can make free telephone calls. 

.CZ> You get your lunch free, 

CD Ym/can buy things cheaper than the 
TMular price, 

Ci:> They pay yout carfare to get to work. 



When would you work on this job? 
CZ> Weekends— Friday, Saturday and Sunday. 

CZ> During the day from 8 o'clock in the morning 
to five oVlock in the afternoon, 

CZ> Five nights a week. 

CZ^ Sometimes during the day, sometimes at 
night. 



lEJJC 



NOTE TO ADMINISTRATOR 
Follow the same procedure 
for 9, 10, and 11. 



for the want ads for questions 6, 7, and 8, and 
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SALES HELP WANTED 

SALESPERSON. 

CAMERAS 
APPtlANCES 
RADIO &TV 

ROBERTSON'S 

VAtLEY STREAM 

Top, notch txptfltncod salts 
psrson nsodsd for our n«w«st 
stort In tho'Qrssn Acres SHop< 
plngCsnttr. 

1PM— 10 PM. 5 days 
or 

ePM--10PM 
High Salary -I- PMS 

Opportunity, to Advanca 
Excallant Banafit Program 
Apply at 
Employmant Of Ilea 
460Sunr<sa Hwy, Valley Ssm 
An Equal Opportunity Employer 



What would you do on this job? 
CD Fix cameras and radios; 
CD Sell things m a store* 
CD Teach people how to drive a car* 
CD Sell houses to people* 



What would you do to get this job? 
CD Write a letter to the manager of the place. 
CD Call the telephone number given in this ad* 



CD Call theState Emplo yment S ervice and tell^ 
them you want to apply* 

CD Go to the address given m the ad and ask 
. about the job * 



When would you woric on this job? 
CD In the momtngs for five days a week* 
CD At night* oh the weekends only* 
CD An y hou rsjMjm^uiays^ou^ant tapicfc: 



CD In the afternoon or at night for five days 
a week* 



AbV.A6ENa 

Hondjt^distri^tm ol rnail 

opp«^onct.^l^^^Qra^^^ Of 
fnSat^Ktl^Nitto^ Good od- 
vonctmen^ oppt/ for olert 
perioo. 

RADIO CITY AREA . 




Ms. Morse 



Orcle 5-1000 



9. 

Where would you work on this job? 
CO In a department store, 
d? In an office. 
CD In a factory. 
CZ? In your own home. 



10. . 

What would you do to get this job? • 

C::> Call the State Employment Service and ask 
them about the job. 

<0 Write a letter to the place that has the job . 

CZ> Go to the place yourself and ask about the job. 

0> Call the place on the phone. 



11. 

What would you do in this job? 
CD Sell things in a store. 
CD Write letters and mail them. 
CD Sort mail and make deliveries. 
CD Fix adding machines and typewriters. 



IKJC 



SAY: Questions 12 through 17 are about parts of an application blank — 

' like the kind you fill out when you go to get hired for a job. Look 
at this part of the application blank and the things it asks you to; 
fill out. i 

NOTE TO THE ADMINISTRATOR 

Allow approximately 30 to 45 seconds for the group to look over the blank. 
TheR read each question and alternatives • 
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APPUCATION FOR EMPLOYMENT 



PERSON At INFOBMATK}N 



t}«tt 



— .--Social Security 

>Jumb«r 



1 NAME 



Ust 



• First 



Middle 



2 PRESENT ADDRESS- 



Str««t 



CU/ 



St«te 



^^3 ^^RMANENT ADDRESS - 



Str0«t 



City 



State ^ 



4 PHONE NO.. 



CITIZEN 
OF U S A. 



YES O 
NO O 



S KIND OF WORK YOU PREFER . 



6 EDUCATION 



CiRCtE THE NUMBER OF- 

THEHIGHESTGRADECOMPLETEO 7 8 9 10 11 12 13 U 



7 OFFICE MACHINES YOU OPERATE 



IF RELATEDTO ANYONE IN OUR EMPLOY. 
• STATE NAME AND DEPARTMENT 



REFERRED BY 



12. 

If you finished high school and got your diploma, 
which number woul^ you circle on line 6? 

c::>ii 

CD 12 



14. 



13. 

What would ypu put on line number 2 where it 
says "present address?'' 

CI5 The address of the place where you live now 

CD The address where a friend lives. 

CZ> The address of the place where 
you're applying for the job. 

Ci:> The address of the place where you worked 
last. 



SAY: 



\ If-yoii have a.i uncle who works fcr this place and 
i he told you about coming here to apply for a job, 
, where would you write your uncle's name? 

ic:>Linel 

1 

^Line.4 
<C5Line7 
|z5Line8 

Now look at the next application blank on page 28 that someone filled 
out. Read that over. 



LERIC 



NOTE TO. THE ADMINISTRATOR 

Allow about one minute for the group to look over the material. Then read 



each question and alternatives. 
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^ MONTH AND YEAR 


NAME AND ADDV^ESS OF EMPLOYER 


SALARY 


POSITION 


REASON rUH LcAViNu 


FROM "77 


Joy Manufacturing Co. 
55 Eaton Place 
Chicago, Illinois 


$4.00 


Parts 

Ace pmH 1 P T" 


Still emo loved 


jQ Present 


FROM Jan 1977 


White's Dept. Store 
735 Walton Blvd. 
unicago, xiiinois 


$2.90 


Packer 


Wanted better 
job 


X/ttmtr 1Q77 

TO 


FROM -J^iy 1976 


West Side Housing Project 
12 W. South Street 
Moline, Illinois 


$2.50 


Maintenance 
Helper 


Wanted more 
money 


Nov 1976 


FROM Mar 1976 


Speed Messenger Service 
15 State Street 
Chicago, Illinois 


$2.20 


Messenger 


Wanted more 
money 


May 1976 



EMPLOYMENT DESIRED 

POSITX>N A 



DATE YOU .V . , OALAHT A/ cn 

CANSTART Anytime desired 

IFSOMAYWE INQUIREOF ^ 

YOUR PRESENT EMPLOYER 



SAURY 



ARE YOU EMPLOYED NOW? 



Yes 



EVER APPLIED TO THIS COMPANY BEFORE? 



No 



WHERE 



WHEN 



15* 

. What job did this person hold right before the job 
heprshe holds now? 

0> Packer ^ 

O Maintenance helper 

CZ? Messenger 

CD Parts Assembler 



16. . 

In the blank where the A is, which of these things 
would make sense if you wrote it? 

CD 247 Jay Street 

C:p$4,40anhour 

CD Sales person 

CD No night work 



;er!c 



17. 

What should be put in the place marked B? 
CD Don't put anything. 
CD Other places the person applied for jobs. 
CD Where the person worked last. 
CD Where the person lives. 

PLEASE STOP HERE. 
WAIT TO BE TOLD HOW TO DO THE NEXT GROUP OF QUESTIONS- 
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' : * ' 
iL'**'- - -* .' 


* " « . ' 




^ >5 
- \' 




ADMINISTRATOR'.SrDIRECTIONSi * Stereotypes of Adult Occupat^^ 




f'vV . ■ ' ' 


SAY? 


Nov turn to page 29 • 




7\ 

V . 1 


' ' ' 

fe: ^' ' 




Look at the directions in .the box at the top of the page* Read them 






silently while I read them out loud.^ 
















K 

). ' ^ 




The statements that follow ;give. the names of jobs that people do . 
' and teli a^little about the job* After each job it asks who you 
think SHOULD do that Job. Answer the question by putting a mark 
in t\\^ boit t^hat! t^ellS' Hdv voti feel about who should do the lob 4 




' ' ' i 


\. 
\ 

\' 

\ 




SSAO 




s 


4 

i ^ 


SAY: 


Number 1. Sewins maching operators are people ^o sew clothing on 




; C 






f 

machines to sell to other people. 






> 




Who do you think should be sewing machine operators? 




. — ^ 






Only women.' 




. . 

f 






)fc>re women than men* 






41 * 


, About the same number of men and women* 










More men thanjwomen. — ^ — 










Only men. 










Iterk the answer that tells how you feel about who should do the job. 


*v 


?■ 


. — . • ^ \ » .1 «•••-,• , ' * 

NOTE TO THE ADMINISTRATOR 




* ? 


f 


Continue reading the rest of the Items In e similar manner. 




.'I: 




J 

< 
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The statemients that follow give the names of jobs that "people do 
and tell -a littU about the job. After each job it a^ks who you 
think SHOULD do that job. Answer the question by putting a mark 
In the box that teils how you feel about who should do the job. 



SSAO 



. • • . , ^ .-^i!^-^ ."^^ 

1. Sewing machine operators are people who sew clothing on machines 
to sell to other people. 

J 

Who do you think SHOULD be sewing machine operators? ^ 

. ■■ . . .. . ^ 

I I Only, women 

□ More women than men 

ri About the same ntmber of men and women 
n More men. than women 

□ Only men 



\ 1 



2. Fire fighters work at putting out fires. 

Who do you think SHOULD be fire fighters? 

' C] Oaly women 

D More women than men 

□ About the same number of men and women 

□ More men than women 
Q Only men 



3. Airplane pilots are people whose job Is flying airplanes. 

Who do you think SHOULD be airplane pilots? 

n Only women 

I 1 More women than men 

□ About the same number of men and women 
Q More men than women . 

□ Only men 

129 ' • . 

Modified and reprinted by permission of the author 



Grade school teachers: aVa pebjple v^ klndergartea or one 

of >the.^£i;cst: sjLx vgrades* ' ' ^ 

Who do yoii think iSHOPLD. be grade school teachers? 

0 Qiiiy wOTen 

More, women than men 
n2 About the same number of men and women 
fn More men than women 

1 I Only men 



Nurses help .take care of people when they* re hurt or sick. 
Who do you think SHOULD be nurses? 

St . * — — - 

□ Only women 

I I More women than men 

i I About the same number of men and women 

I I More men than women 

: Only /men ' 



Store salespeople work in shops or stores selling things to 
their customers. , | - 

Who do you think SHOULD be store salespeople? 

□ Only women o 
|~1 More women than* men 
CD ^ Abou£ the same number of men and women 

More men thanr women 
\ 1 Only men 



Train enf^ineers are people who are paid to drive trains. 
Who do you think SHOULD be train engineers? 

□ Only women 

□ More women -than men 

About the same number of men and wometi 
IT) More men than^ women 
~ □ Only men 
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Elevator operators are people vho are paid to run clevatorn, 
taking -people up and down in tall buildings. 

Who do yoa think. SHOULD be elevator operators? 

Q Onljr women v 

□ More women than men 

About the same number of men and women 
n More men than women , , 

rn Ctoly men ^ ^ 

^ * 

Mail carriers bring mail to homes and businesses. 
Who do you think SHOULD be mail carriers? 

□ Only women 

0 More women than men 

1 I About the same number of men and women 
I 1 More men than women 

n Only men 

Ballet dancers are people who work performing for others by 
dancing gracefully to music* 

Who do you think SHOULD be ballet dancers? 

0 Only women 

1 I More women than men 

I 1 About the same number of men and women 

□ More men than women 

□ Only men 

Writers are people whose job is using written words to tell 
others about their thoughts and feelings. They write books, 
stories, plays, and poems. 

Who do you think SHOULD be writers?' 

I I 'Only women 

I 1 Mo.re women than men . 

□ About the same number of men and women 
n More men than women 

□ 'Only men 
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12. Carpenters are people who make things out of wood to sell. 

» «.* ^ * * 

•Who do you .think SHOULD be carpenters? . 

* • * , 

E3^ Only women 

□ More women than men 

- . . O <About the same ntimber of men and women 

/ □ More men tlian women 

O Only men^ 



;13. Librarians are people who work in libraries checking books in 

and out. ' . , ^ 

* , 

Who do you think SHOULD be librarians? 

□ Only women 
' O More women than men 

About iEhs same number of men and women -^r . 
\ I More men than women 
O Only men 



14. House cleaners are people who ar^ paid to keep, other people's 
houses clean. ' 

. Who do you think SHOULD be /louse cleaners? ' 

I I Only women 

■ □ ,Mor3 women than men 

□ About, the same numbc?^^^ men and women 
\ 1 More men than women 

□ Only men — ^ 

15. Secretaries are people, who work in offices answering telephones, 
typing letters and papers, and greeting visitors to their offices. 

Who do you think SHOULD be secretaries? ' 

□ Only women ^ 

□ More women than men 

0 About the same ntimber of men and women 

1 ) More men than wcsnen 



l\ O ^ • □ Only men 
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16* Plumbers are people vho fix pipes ia houses 'and other buildings. 

Who do you think SHOULD be plumbers? 

, □ Only women * 
vMore women than men 

□ About the same number of men and women 
^ □ More men than women 

□ vDnly men 



17,. " Football! coaches are people who coach football teams. 
Who do you think -SHOULD- be football' coaches? 

□ ■ Only women 

_ ri More.-women. than men- . 

□ About the same nuipber of men and women 

□ More men than vomen 

□ Only men 



18* Restaurant cooks are people who fix meals for the re^aurant s 
customers. ' . 

Who do you think SHOULD be restaurant cooks? 

□ Only women 

, ^ • Q More women than men 

□ About the same number of men and women 

□ More men than wcanen 

n Only men^ ^ 



19.- Bus drivers are people who drive buses » collect ticketsNxx money 
and give directions and Information to the passengers. 

Who do you think SHOULD be bus drivers? 

E3 Only women 
^ D More women than men 

C3^ Abqut the same number of men and women 

□ ^Mo^^en^tha^ Iwomen 

□ Only men [ ' 



Ship captains are people vho are In charge of large boats. 

Mho do you think SHOULD be ship captains? 

* <? 

□ Only women 

□ 'More- women than- men 

\ I About the same number of men and women 

□ More men than women 
n Only merf 

Airplane attendants work on airplanes serving food and drinks. 
They make sure the passengers are safe and comfortable. 

Who dp you thliik SHOUIJ) be -airplane attendants? 

□ Only women 

I 1 More women than men"' - 

□ About the saane number of men and women 

I ] More men than woAen 

n Only men 



I 



PLEASE STOP HERE. 
Wi^T TO BE TOLD HOW TO DO THE NEXT GROUP OF QUESTIONS. 



The pictutc$ thit follow show cvciydAy kin^. of situatioiis in which a person might be involved.^ 
l^KiTBies^ next to thTwi^tHittelis Beit hoWyou^wottW4ed if ycm wew that 



scene* 




1. 

If you were the person getting the diploma how 
would you feel? ~" " 

■^^-The diploma's not going to do anythingio 
« help someone like me. ^ 

Ol might get a little betterjob with the - 
diploma. 

CD I could really have it'made with a diploma. 




2. 



V 



What would you think if someone at the job said 
this to you? 

e 

CD 1 would probably be the last person they 
would give apromotion to. 

CD 1 would be one oi the first people fo get , 
promoted on a job. 

CD 1 might stand a ch*»nce for getting a promotion. 



1 Qtr 




\ 3. 



How do you think youM make out if you were in 
court? * ' 

CDThe judge would probably go easy with me— 
Tm worth giving a chance;^ 

CZ^ i would probably get the worst possible - 
punishment there is. 

CZD I would probably get a small fine^rbut 
nothing too bad. 




4. 

If you were the person the counselor was trying to 
help» how would you feel? 

CD There's probably nothing much the counselor 
could do for me. 

' ♦ 

CZ> I know I could ihake good on a job if the 
counselor helped me get the right training. 

C^i might stand some chance on ^job if I could 
get some kind of training. 



/^TAKE SOMEEWPRA 




■5. ' 

HoW'V;ould you feel if the teacher said this to you? 

CD It wouldn't do any good — I wouldn^t learn 
anything anyway. 

Celt's always w6irtlrtrymg~l can learn with 
some help. 

CD IMl try, but it might be a waste of time. 



r 
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6- 

What would you think if one of your parents told 
you this? 

0> I could really make good if my family was • 
willing to make plans with me^and back me up, 

<0 Planning out my future with my family 
wouldn't do any good— I wouldn't make 
it anyway* 

CZ> Maybe I couljd make it if my family backed me 
up—but I hjave my doubts. * f 




7- 

How do you think you'd make out if a job inter- 
viewer said this to you? 

I 

CD They would probably tell me I'm someone 
they can't use* 

CD I think they would offer me a pretty good job. 

CD They might offer me some kind of a job— but 
nothing too good. 4 



I 




1 



' WANTED n 



8. 

How.would you feel if/yoasaw this sign? ^ 

'( 

<Z:> I might try for a jbb in that store, but they 
probably wouldn't want me. 

CD They would turn me down cold and wouldn't 
think I.'m worth giving a chance. ~^ 

CD They would/think I'm worth hiring f^a job 
in that store. 



•^38- 




9. ^ 

What usually happens tfyou are waiting to be 
taken care of in a store? 

CI> I usually wdit until the sales person gets 
around to paying attention to me. 

C3 1 would walk away if the sales person is busyr— 
they usually treat me lil^e nothing* 

CD I usually demMd good service and expect to 
be waited on right away* 




10. 

What would you do if someone came to your door 
.and said this? 

CD I would register and vote — it's the only way 
I can make things better* 

CD I'd register and vote— but it*s not much use 
for improving things* 

CD No sense in even bothering — my vote doesn't 
change what happens to me* 




11. 

How do you think you would make out if you were 
one of the people the cop was talking to? 

CD If I didn't do it* the cop wouldn't blame me*, 

CD The cop might blame me— but I don't think I 
would get in trouble if it wasn't my fault* n 

•CD Tm usually the one who would get blamed and 
arrested even if 1 didn't do anything* 



r 




12.. 

How would you feel if you were the person talking 
to the group? 

CZ5 I'm not sure people would pay too much 
attention to what I have to say. 

CD People wouldn't listen to someone like me. 

CD I can get across what I have to say and people 
usually listen. 




13. 

Suppose you weris the person being cheered by 
the crowd. How would you feel? 

CD Tm the kind of person wjio can be a leader and 
who people look up to— like in this picture. 

CD 1 could never be like that person in the picture 
with people.cheering me. 

CD I might be good at some things that people 
would look up to me for. 



14. 

How do you feel when a sales person is showing 
you something? 

CD Vm always treated right and get good service 
from a sales person in a store. 

CD People who sell things in a store often treat 
me like Vm nothing and try to get rid of me. 

CD Sometimes sales people don*t pay too much 
attention to me— but it depends on the store. 
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IS. 

How do you think you would do if your supervisor 
at work said this to you? 

Cr!> I might stand a chance for getting more pay 
on a job. 

CD The odds are they wouldn't think I'm worth 
more pay. 

CII> I would usually be the first one to get more 
/pay on a job. 



V 



\ 



\ 



\ 




CONTROL' GROUP STATUS ' SURVEY 



Interviewer Instructlone 



Print the name of the project «t the top of -page 1 of the survey^ 

Please read the directions on the cover sheet of the Status Survey to the^ 
respondciit. Then read aloud each of the questions in the survey. You 
■ay show the, questions to the respondent as>you read them. Fill in the 
responses as the respondent answers each question. This instrument should 
be filled In b y the interviewer only. 

Try to read and explain the material in a relatively informal manner. ^ 
The approach is one of working with the respondent to obtain information 
that is as accurate as possible. 



Item 1: 



ETS ID Number. Enter this number in the 
boxes provided. The ID numbers for the 
pretested control group mexnbers are listed 
on the rosters sent to you by ETS. 



Items ^"20 : ' Self-explanatory. Fill in as Indicated. 

(Notice the "skip" instruction for Item 15, 



Ifm/ 2 Wi t - SftifrMplasuitory* Fill In as Indlcattd. 

'\ . For TtM 32 9 amke a note ^.regarding respondents 

jfho pre not looking for a job because' they 
are In school ^ eVc. 

Itmm 32-33 ; Probe for a job choice when the respondent 

seeM hesitant or uncertain about whatjob— 
or she^vould^look for or like best. 

*^ — Obtain a specific occupation vh'en probing 

-for a job choice. For exaaple^ ^salesperson" 
or "•tock clerk" r«th»r than "work In a store"; 
"••crttary," "receptlonlut," or "bookkeeper" 
rather than "work In an office." 



IteM 34-42 ; Self-explanatory. Fill In as Indicated. For 

- IteW 37, 38 and 39, If asked, faally «ay be defined 
as "anyone related to you by blood or aarrlage". 
(Notice the "skip" Instruction for Itea 37.) 

X 

Itea Ag : - Notice that, "trouble with Police" Is defined as 



"arrested t charged or booked." As noted In the 
survey 9 status offenses would Include parking 
tickets or runaway. 



Item 44: Self-explanatory. 



1^2 



I 

' ^ t 

J^'Of thi lnfomtion obtained in this lt«a 
■hoiild. bft dttplleiitcd and kaot in your fiU < 
•lnc« it C9uld b« helpful in futuri follow-up 

. efforts. / ' ^ 



lii"d"t6« pert, about peyi^nt for folloi»-up 
only if you ere sure thet your progriui is 
doing so. ' ' 



It— 46: 



Ask the respondent if th«^e are eny connents 
that he or she would like to awke. Such coasMnts 
sight include feelings about the survey questions i 
the interviewer* etc. Please record these coastnts 
as close to verbatim as possible. 



JERIC 
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Program Cpmpidtion Survey 



• W»'re trying to ffnd.out how People v^b have been In your training * 
progrorn for o while hove been iir>ce they left theprogrqm-IIke ' 
how Ihlrigi hove bi^n v^ing putforybu what yc; ^Ink 
you've gotten out 6f being In the program; y^ot you are doing now and 
what things you would like to do from now on; how you feel about Jobs; 

, ""and so on^VVId would like to know your feelings about these thirigs. 
^ plon to use what we find out to make prpgroms like this better for trainees. 

• 1he answers you give to any questions will all be confldentidi and private. 
Anything we lind out frorn these Intervievvs will be reported for o whole 
group at a time pike q few hurtdried) so that no one can know your answers. 

• However, all the information requested is Important and your response to 
each question will be appneicigteid. 

• i^t me go over the questipris.with you. It should take no more than about 
^ 25 rDlnutes. Remember, if you don^t understand a question, please stop 

me to make sure it's clear. 



ASSESSMENT OF YOUTH ALTERNATIVES PROJECT 
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Counseioi's Rating F^rm 



PROJECT, 



CITY 



Couniekx'sNafne 



Dote, 



NCNTieofErvoikie 
BalngRated' 



On thl$ $heet ore 11 stotemenU about enroHee behavior that counselor^ consider Important In 
deteimlnlng how well an enroKee is coming along would appreciate your evaluation of 
how these apply to tNsenrollee. • ^ 

flease read eoch statement carefully. Then circle one of the numbers 1 to 5 that best Indi- 
cates how the statement applies to the enrdlee" 



1 = thls 2=:Thl$ls* 
describes true 
tt^WoHee mcstof 
perfectly. the time. 



3 s Sometimes 
this is 

true of the 
ervoUee. 



4 -This is 
not 

usually 
so. 



5s=TheervoHee 
Is not 
like this 
otalL 



I. Pays ottentlon to good grodrolng orxJ dresses oppropriotely . . . . 
2 is not very open about discussing persor^l and job problems. . . 

" 3. Shows 0 lot of resentrhent and hostility 

4. Iscooperativo and wlllir)g to listen to advice 

5. Makes realistic plans about future Jobs 

6. Shows little poise Of self-ossurance 

7. Is coherent in expressing Nmself (hersetf) 

8. 1$ motivated to wont to work and expend effort 

9. Does not show good day-to-day pkannlnp so that he (she) con 
handle the job (let's home life interfere, for example) 

0 

id; . Indicates a willingness to enroll in school 

or some sort of training on o port-time basis 

II. Shows qualities that indicate he (she) 

wi« do well after Jeavlno the program 



CIRCLE ONE NUMIER. 

'2 3 .4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 

.2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3' .4 5 

2 3 4 5 



ASSESSMENT OF YOUTH AUFRNAnVES PROJECT 

Program Compietibh Survey 



PROJECT. 



cnv 



1. EBI.D.NO. 



2. DAfEOF 
INTERVIEW 





^ 









MONTH CAY YEAR 



3. NAME OF RESPONDENT. 



LAST NAME 



RRSTNAME 



4. HOME ADDRESS. 



NUMKRANOSTREH 



OTYANOSTAJE 

TELEPHONE NUMBER WHERE RESPONDENT CAN BE REACHED 



ZIP CODE 



AREA CODE 



TEEPHONE NUMBER 



RESPONDENT'S SOCIAL SECURITY NUMBER ... 
SEX □ Male □ Female 



8. DATE OF BIRTH 



MONTH 



DAY YEAR" 



Since YQuVe been In the p\>Qram have you been 

v/orking on a general equKol^r.ov high schco; diploma (GED)? Ye^ □ No □ 

Po. If yes/hav3 you gotten IheGSD yet?... Yes □ No □ 

9b. Did you get (or will you be getting) your high school diploma In June? 
□ Yes 



□ No: Will get It later (end of 
summer or next school year). 



□ No: Leaving school 
without It. 



10. 



What types of things did you port in during the program? (Check all those v^lch are applicable.) 

1 □ Personal counseling 5 □ Oossroom training: GED 

2 □ Job counseling ^ □ Working on a Job 

3 □^Classroom training: vocational skills 7 □ Referral to a full-time perrnanGnt Job 

4 □ Classroom training: remedial education 8 □ pth(9r (specify)- 



11 



Of the things you took port In during the program, v^lch two do yoi« think v^3re mosthelpful to you? 
(Check only two.) 

1 □ Personal counseling 6 □ Classroom training: GED 

2 □ Job counseling 6 □ Working on p Jo'* 

3 □ Classroom trolning: vocational skills 7 □ Referral to a full-time perrrionent Job 

4 □ Classroom training: remedial education 8 □ nthaf (spArJfy)' 



12. 



13. 



How do you feel about your experiences In the program? 

□ Very satisfied □ Satisfied □ Very dissatisfied . 

Are you still enrolled In the program? 

□ Yes (SRlp to question 22.) □ No (Go on to question 14.) 



14. How many v/eeks has It been since you left the program? 

... " : i-ie 



.WEEKS 



• ' ;[li:Vtt (<^6n to quattlpn 16.) ' ' □ No (Sklpio qu©stion!20.) 

16. Are.you pceientiy vibrklng 30 or rTK)re tfq^^ - - 

□;Ye$ (Gb'on to question 17.) . □ No (Skip to question 21) 



17. Where do you work? * . NAMeoFCOMfv^Nv- 



NUMKR AND STRECTpft (K)UTE. 
CITY AND SWE i2 - 



TELEPHONE NUMBER ^ ). 



18. Wtiat lsyourjobtltle?..^ — ^ — 

19. How helpful was tbe program In preportng you for this job? " . . *. 
\" Q^jtwasno helpatqll. □ It helped, a little, now arid ^en, Q It was veiy helpful Inj lot of ways. 

\ ' tSkIp to question 22.)- . ' 

20. \lqve,you wofkecl since leaving th^ prbgrann? , □ Yes □ No 

21. \A/hat arfe you doing now? (Check aN those which are applk:able.) 

1 □looking for a job 3 □•in another CETA training program 

2 Q In school ' 4 □ Nothing special (Probe: How do you spend yoOr day? Briefly (^escrlbeO 



\ 



\ 



' I would like to know what you'^think about certain things relating to Jobs 

22/Do you think you're "bble to get the kinc! of Job you want? 

• Hi would have a □ I might have Qi won't have 

very good chance'. \ • some chance. ^ - much chance. - 

23. Do you thinK you're abie/o do the work on the Job weil enough (O satisfy any boss? , 

□ 1 won't be abie X □ i might be abie □ i definitely wiii be 

to, on most Jobs. \ to, on most Jobs. able to, on any Job. 

24. Dp you think you're able to get by a Job Without a lot of help from the boss, or the people yoawork with? 

* n Yes I'll get by on • □ I may need d little □ I'm golr>g to need a lot 
my own without help \^\P sometimes. of help from other people. 



\ 

\ 



25. Do you think, 'if you have to learn something new on a Job, you coukl learn enough to do the Job right? 
n Yes, I couW, anytime Q Maybe I could learn, □ l would have a tough time If 1 

for any Job. ^ for sorne Jobs. have to learn something new. 

26. Do you think you've got what iftakes to get'promoted and move up to better Jobs?" - 

□ it would be rough for ' Q Maybe 1 could, ' , Q 1 could get promoted 
' me to get promotions. • on some Jobs. for sure, on any Job. 

27. Do you think being in the program has made you feel more like you're going to be able to make it in a Job 
later on? 

□ it was no h^lp to me at all. ' |j It was some help to me. □ it helped me a lot. 



People look for dWerent things In their choice of jobs. 



28. How Important to It that you get to do Interestfog work? 



. Q-Thaf $ real Important 
tome. . 



□ Jt rndy be Important; 
I'm rSottoowre. 



Q I don't reolly 
care about ttiat. 



29. How important Is It that you can' get pakJ what you're worth? 

n "fhof $ real Impohont □ It mcy be Important; 

tome. I'm not too sure. - 

.,30. How Important Is It that you wouldn't have to worry about being fired? 



□ I don't really 
core about that. 



Q That's real Important 
. Jo me. 



□ It may be Important; . 
I'm not too sure. 



□ I don't really 
core about that. 



31. HoW^lmportont Is It that you feel 'llke you're doing work that's worth doing? 



n That's real Important. 
*td me. • 



□ It may be Important; 
I'm not too sure. 



□ I don't really 
core oboutthot. 



32. How Important Is It that you con get raises and moke more money fast? 



tj- That's real Important 
'* tome. 



□ It may be Important; 
I'm not too sure. 



, 33. How Important Is It that you hove a chance for steady work? 



That's real Important 
tbtne. 



□ It may be Important; a 
I'm not too sure. ^ 



□ I don't really 
core about that. 



□ I don't really 
core about that. 



34. Wiot'klnd of full-time Job would (did) you look for right after leaving the program? 
Write In kind of Job: L 



35. Wiot kind of full-time Job woukJ you like best right now? _ 
Write In Job choice: ^ ^ 



36. What Is the lowest hourly pay you wouki 

take for the Job you would like best right now? $ 



37. How much do you know about what it takes to do the Job ybu would like best right now? 



□ I know 0 lot about 
that kind of Job. 



□ Lknow a few things 
about what the Job takes. 



□ I don't really 

know much about It. 



38. How willing woukj you be to go Into a training program for the Job you would like best Hght now? 
(Check only one.) 



1 □ I woukJn't bother. 

2 Q I wouki do It only if I were poki. 



3 □ l.would clo It for no pay. 

4 □ I am already trained for that Job. 



39. Since being In the program, has there been a change in the way you get along v/ith your family? 



□ I have no family. (Skip to question 42.) 

□ i get along better with . □ I get along worse with 
them than I used to. them than i usdd to- 

/ 



□ I get along with them 
the some way I always did. 



40; How does your family feel about hpw you're doing (did) In the program? 

□ They think I'm doing great □ They thinki'm getting by okay. □ They think I'm doing pooriy 



41 Out of vyhotypu earn a week, about how much do V'ou give to your family? ...S mm. 

□ ldOf\;ieamanymoney. ■ ' * 

' ^ . mm xm 

42. SlfK»belfKlln the program have' . 1) Savihgs □ □ □ 

' there been any . changesin the 2) Home and family (rent, food, clothing) □ . □ □ 
' you use yoUr money? 3) Leisure (recreation) Q □ □ 

(Check one box In each row.) 4) Education □ □ □ 

43. How often do yoiJ save money from your pay? (Check only one.} . 

□ I don't earn any money. 

' n I save something □ Sometimes! save. ° 

. • » . any or my pay. 

44. Whteh of these people or agencies have been giving you a hard time latety?.(Check as many a$ appV.) ♦ 

1 □ Supejvlsoratv^rk 6 Q The ^dic^orjhe c^^^ 11 □ Somebody In your family 

2 Q People yoCiwortc Avlth 7 □ Neighbors ^ 12 □ '^^^f^'^^'^^^ 

3 □ Social worker (Welfare) . 8 □ Lawyers (like the doctors; the clerks) 
AQ Emp!oytT)ent agencies 9 □ Credit collection outfits 13 □'Friends. 

5 □ Program' people . 10 □ Storekeepers ^ * * ^ I, 

(like the counselor) ^4 q others (specify): . ^ ■ 

45. sine* yoi'v* bMn in progwrn have you gotten in any trouble witt^ ttie police: been arrested, chjarged 
or booked? (Do not Include status offenses, such as parking tickets or runaway.) 

□ No ' ' V / 

□ Just once. g A couple of time's ' □ K^ore than g couple of times 

46. How Important is It to you to keep out of trouble with the police and the law? ^ j ■ 

□ Real importont: I go cut of □ 1 usually try to steer clear unless □ Not too Important; If 1 get In 
mvwo vto gyoid trouble. ^ I'm pushed reol hard. trouble I don't care too much. 

— ~~ ■ ' - - ' ^ 

47 Vte appreciate the help That you've given us. Wb would like to keep up with how you're doing. We will want 
' to talk with you again In the next few months. At that time we'll pay you S5.00 for your help. Please give us 
the names and addresses of tv«> people v^o will know where to reoch you during the next few rponths. 

Name ^af"® 

Address ^ Address ■■ ■■ 

Phone, Phone ■ 

Relationship Reiationshlp_ ^ - 

3^ ' 

48. Additional Commenttl9yVoutti: , 



AHACH ADDITIONAL SHEET. IF MORE SPACE NEEDED. 



Addmonol Infonnallon [to be obtained by Inteivlewef from the program records] 



1) 'Number of different work sites to which the 
/ enrollee has been assigned since Joining the program - 



2) Number of. days 

absent from the program . 



/ 



1 d .Q 



^yVork Sm Rating Form 



PROJECT. 



ctry 



WDfk Supervisor's Name . 



Name of Enrollee Being looted . 



How many months has the enrollee worked for you?. 



Date. 



HE 



ETS1.D. NUMBER 



Below ore 10 staternents about things that work supervisors consider Important when It comes 
to how the enrollee is doing. We would appreciate your telling us hov^' each one applies to 
this enrollee. The Information Is ttrictty private and will not have any effect on the enrollee 
Id any way. 

Pleose read each statement carefully. Then put a check in one of the five boxes to show how 
ttiat statement fits the enrollee. that you're rating. 



1. KNOWS HOW TO FOLLOW INST|?UCTiONS PROPERLY, 



Thio describe^ 
Just how the 
enrollee is. 



This is true ^ 
most of the 
timp. 

a . 



Sometimes this 
. Is true of the 
enrollee. 

Ik 

□ 



This is not 
usually so. 

□ ■ 



The enrollee 
Isnot'like ;^ 
this ot dli;- 



Z RESENTS lAKING ORDERS FROM THOSE WAG SUPERVISE HIM/HER. 



This dejcrlbes^ 
just' how the 
enrollee is.* 

□ 



This Is true 
most of .the- 
time. 

.; □. 



. Sometimes this ■ 
Is true of the 
eryollee. 

-> □ 



This is not - 
usually so. 



3. KNOWS HOW TO DRESS RIGHT FOR THE JOB. 



This descri(>es 
Just how the 
enroileeis. 



This is true 
most of the 
time. 

□" • 



Sometimes this 
Is true oT the. 
.er>follee. 



This is not 
usucliy so. 



Tiie ehrojleq 
is not like \ 
thii dt all. 



The enrollee 
is not iike*" 
this at all. , 

□ 



4. TAKES SOME PRIDE IN THE WQRK AND D0ESN7 JUST RUSH THROUGH TO GET IT FINISHED. 



This describes 
Just how \h'e 
enrollee is. 

■ □ . 



This Is true 
mo^t Of the 
time. 

□ 



Sometimes this 
is true of the 
enrollee. 

□ 



This is not 
usually so. 

□ 



The enrollee 
is not nice 
this at all. 

D 



PLEASE CONTINUE ON REVERSE. 



ERIC 



5. HASTOBETOIJ)WHArTODOB/ERYMINUreORCANTKEEPB 



This describes 
Ju^ how the 
enrollee Is. 

□ 



This Is true 
most of the 
time. 

□ 



6. GETS ALONG WITH OTHERS ON inEJOB. 



This dexribes^ 
)ust how the 
enrollee Is. 

. □ 



This Is true 
most of 
time. 

□ 



Sometlnnesthis 
Is true of the 
enrollee. 

□ 



Sometimes this 
Is true of the 
enrollee. 

□ 



This Is ncjt 
usually so. 



□ 



This-ls not 
usually so. 

Q 



The enrollee 
Is not like 
this at all. ' 

□ 



The enrollee 
is not like 
this at all. 

□ 



7. CANT GET TO WORK ON TIME. 



This d,escribes 
Just how the 
enrollee Is. 

□ 



This Is true 
most of the 
time. 

a 



Sometimes this 
Is true of the 
enrollee. 



This Is not 
usually so. 

□ 



The enrollee 
is not like 
this at all. 



8. SHOWS SOME INITIATIVE IN TAKING ON A PIECE OF WORK. 



This describes 
Just how the 
enrollee is. 



This Is true 
most of the 
time. 

□ 



Sometimes this 
Is true of the 
enrollee. 

□ 



This Is not 
usually so. 

□ 



The enrollee 
is not like 
this at Gil. 

□ 



9. DOESNT MAKE TROUBLE ON THE JOB. 



This describes 
Just how the , 
enrollee Is. ^ ' 

□ 



This Is true 
most of the 
time. 

□ 



Sometimes this 
is true of the 
enrollee. 

□ 



This Is not 
usually so. 



The enrollee 
is not like 
this at all. 

□ 



10. ASKS QUESTIONS IF PROBLEMS COME UP-EXDESNT JUST GO AHEAD AND DO THE JOB WRONG. 

This Is not o The enrollee 
usually so. Is not like 

this at OIL 



This describes 
just how the 
enrollee Is. 

□ 



Ihls Is true 
most of the 
time. 

□ 



Sometimes this 
Is true of the 
enrollee. 



□ 



□ 



□ 
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CONTROL GROUP STATUS SURVEY 



• This instrument is to be filled in by the interviewer, 
NOT the respondent. 

• We're trying to .find out how people have been do ig since 
our last contact*-*-like how things have been working out 
for you in general; what you are doing now and what things 
you wouldf like to do from now on; how you feel about jobs; 
and so on. We would like to know your feelings about these 
things^ ^ 

• The answeisyou give to any questions will all be confidential and private. 
Anyttiirtg we find out from these interviews would be reported for a wtiole 
group at a time (like a few hundred) so that no ofie will know your answers. 
However, all, the Inforrnation requested is Important and your response to 
each question v^nl^ be appreciated. 

• Let me go ov*ef the questions with you. It should take no more than about - 
25 minutes. Remember, if you don', understand o question, please stop 
me to moke sure it's clear. 



ASSESSMENT OF YOUTH ALTERNARVES PROJECT 



ASSESSMENT OF YOUTH ALTERNATIVES PROJECT 



^Zei 



CONTROL GROUP STATUS^ SURVEY. 



1. ETS ID. NO. 



PROJECT. 



2. DATE OF 
INTERVIEW 



MONfH OAY V(Aff 



3. NAME.OF RESPONDENT.! 



iASTNAM€ 



f fiST riAME 



4. HOME ADDRESS 



NUMBER ATOStRtH 



OrVANOSIAIE 

. 5. TELEPHONE NUMBER WHERE RESPONDENT CAN BE REACHED 



MCA COM 



6. RESPONDENT'S SOCIAL SECURITY NUMBER 



7. SEX □ Male □ Female 



8. DATE OF BIRTH 



Z)PCOO€ 



lamoNENuMm 



MUMH DAY YCAR 



9. Hwe you been- working on a general equivalency 

high school diploma (GED) over the last 6 months? -Yes LJ U 

9q. If yes, have you gotten the G|D yet? Yes □ No Q 

<?b. Did you get (or will you be getting) your high school diploma In June? 

Q Yes □ No: Will get it ioter (end of Q No: Leaving school 

summer or next school year). withbut it. 

10 • Over the last 6 months, have you been enrolled in any government- 
sponsored employment and training program? (If yes, on this list, 
enter the number of weeks that you were in each program.) 



1 
2 
3 
A 

.5 
6 



CETA Job or Training f^l 1 weeks 



Summer Youth Program 
Job Corps nn weeks 



weeks 



Young Aault Conservation Corps r / 1 weeks 

Neighborhood Youth Corps TTl weeks 

Other- Government Sponsored Programs n | weeks 



(Name of Program) 



'eric 



11. What types of things have you taken part in over the last 6 months? 
(Check ALL those which are applicable.) 

1 □ Persona! counseling 5 □ Classfoom training: GED 

2 □ Job counseling 6 □ Working on a job 

3 □ Classroom training: vocationol skills 7 □ Referral to a full-time permanent lob 

4 Q Classroom training: romedial education 8 □ None 



15 



12» Of the things you took part in over the last 6 months, which TWO • 
of you think were most helpful tc you? .(Check only TWO.) 

1 □ Personal counseling S □ Classroom training: GEO 

2 □ Job caunseling 6 □ Wbrklng on o Job 

3 □ Classroom training: vocational skills 7 □ Referral to a full-time permanent job 

4 □ Clasyocm training: remedial education 8 Q None 

13. How do you feel about what you have been doing over the last 6 months? 
□ Very sofisfled □ Satisfied □ Veiy dissatisfied 

14» Have ycu worked at any time during the last month? j □ Yes □ No 

15* Are you presently working? 

P Yes (Go on to question 16 ) ^ □ No (Skip to question 20) *^ 

16 • Are you presently working 30 or more hours per week? 

□ No, 



□ Yes 

17 ♦ WiOfO do you work?' 



MAM€ or COMPANY. 



NUMKR AM) STR€ET Off POUtE . 
Cir/ANOStATE 



fCUPH0N€NUMaf»( 



18 . What is your job title*>_ 



19. Which one of the following sources was most helpful in getting you your 
Job? (Check only one.) 

1 □ School Counselor 

2 D Friends or people in neighborhood 

3 D Newspaper 

4 D Government (public) employment agency 

5 □ Non-government (private) employment agency 

6 D Family 

7 D Help wanted sign 

8 □ Church or community leaders (e.g.. teachers, miriisters. and so on) 

- - - Other (specify):— , 



0 D None of the above: I got it on my own. 



20 » Whot ore you doing now? (Check all those v^lch ore opptlcoblo.) 



1 D Working and not 

looking for a Job 

2 D Looking for a job 

3 n school 



4 □ In a CETA training program 

5 □ Nothing special (Probe: How do you spend your doy? Briefly describe!) 



ERIC 



I would like to know what you think about certain things reldting to Jobs. 



21 • Do you think you're oble to get the kind of Job you wont? 

^ □ I would^hove o □ I might hove □ i won't hove 

^ ^ry good chonce. some chonce. much chonce. 

22 • Do you think you're oble to do the work on the Job well enough to satisfy ony boss? 
n I won't be oble □ I might be oble ' □ » definitely will be 

to. on most jobs. to. on most jobs. oble to, on ony job. 

23 . Do you think you're oble to get by on o job without a lot of help from the boss, or the people you work with? 

□ Yes. I'll get by on □ I moy need o little . □ I'm going to need o lot 
my own without help ^ ^ help sometimes. of help^ from otherpeopte. 

24 . Do you think, if you hove to leorn something new on o job, you could leom enough to do the job right? 
n Yes I could, onytime ' □ Moybe I could leom, □ I woufd hove o tough time If I 

for ony job. tor some jobs. hove to leom something new. 

25. IP you think you've got whot it tokes to get promoted orid move up to better jobs? 
^ * □ It would be rough for ^ □ Moybe I could. • □ I could get promoted 

me to get promotions. on some jobs. far sure, on ony ]ob. 

25 How fmportont is it thot you get to do Interesting work? 

□ Tbot's reol importonJ P It moy be importont; □ I don't really 
tome. ^ I'm not too sure. core obout thot. 

27 . How importont is it thot you con get paid whot you're worth? 

□ Thot's reol importont □ It moy be Importont; □ I don't reolly 
to me. I'm not too sure. core obout thot. 

28 . How importont is it thot you wouldn't hove to worry obout being fired? 

□ Thot's reol importont □ It may be importont; □ I don't reolly 
tome. I'm not too sure. core obout thot. 

29. How importont is it thot you feel like you're doing work thot's worth doing? 

□ Thot's reol Importont □ It may be Importont; □ I don't reolly 
tome. I'm not too sure. core obout thot. 

30 . How Importont is It thot you con get roises ond moke more money fost? 

□ Thot's reol importont □ It may be impcrtont; □ I don't reolly 
to me. I'm not too sure. core obout thot 

31 . How Importont is it tho? you hove o chonce for steody work? 

□ Thot's reol importont □ It moy be importont; □ ! don't reolly 
to me, I'm not too sure. core obout thot. 



32. WhQt kind of full-time job would (did) you look for right now? 
• Write In kind of job:, 



33 . What kind of full-time job vy/ould you like best right now? 
Write In job ctioice- '. 



3^ • Whiat is the lowest hourly pay you would ' ■ 
take for the [ob you would tike best rigtit now? . 



35 , How much do you know obout what It takes ta da the jab yau would Hke best right now? 



□ I know o lot about 
that kind of job. 



Q I know a few things 

obaut what the job takes. 



□ I don't really 

know much about it. 



36. How willing would you be to go into a training progrfim for the Jab you would like best right now? 

(Check only one.) ^ 

1 □ I wouldn't bother. 3 □ I would da It for no pay. 

2^1 would do it only if I were pakj. 4 □ I om already trained for that job. 

37. Over the last 6 months, has there, been a change in the way you get along with your 

□ 1 hove no fomily. (Skip to question 40 ) ' ^ family? 

Q I get olong better with ^ Q | get along worse with □ I get along with them ^ 

ihem thon I used to. them than I used to. the some way I always did. / 

? 

38. Hawdoesyour family feel about how you've been doing over the last 6 months? 

□ They think I'm doing great. , □ They think I'm getting by okay. □ They think I'm doing poorly. 



39 . Out of what you eorn a week, about how much do you give to your family? S mm. 

Q I don't earn ony money. 

MOtC lESS SAMf 

40. Over the last 6 months,have ^) Savings □ □ □ 

there been any changes in the 2) Home and family (rent. food, clothing) □ □ □ 

way you use yaur money? 3) Leisure (recreation) □ □ □ 

(Check one box in eoch row.) 4) Wucation □ □ □ 

41. Haw often do you save money from your pay? (Check only one.) 
□ I don't earn any money. 

n I sove something □ Sometimes I save. ' □ I never sove, . 

^ any of my poy. 

42. Which of these people or ogencles have been giving you a hard time lately?.(Check as many as apply.) 

1 □ Supervisor ot work 6 □ The police or the courts H □ Somebody in your family 

2 n People you v^rkwWh 7 □ Neighbors 12 □ A hospital, or people who 
^ work in a hospital 

3 □ Social'warker (Welfare) 8 □ Lawyers (like the doctors; !he clerks) 

4 □ Employment agencies 9 □ Credit collectior^ outfits 13 □ Friends 

5 □ School Counselor 10 □ Storekeepers 

1 /, □ Others (^r^ocify) — 



43. Over the last 6 months, have you gotten into any trouble^-with the police; 
been arrested, charged or booked? (Do not include status offenses, such 
cs parking tickets or runaway.) 

□ No 

□ Just once. □ A couple of times O More than o couple of times 

. How impoftdnt is it to you to keep out of trouble with the police and the low? 

n Real important; I go out of □ I usuolly tiy to steer clear unless Q Not too important: If I get In 
my way to avoid trouble. Um pushed real hard. trouble I don't care too much. 

AS :Je appreciate the help that you've given us. We would like to keep up with how you're doing. \Ate will want 
' * • to talk with you again in the next few mor^ths. At that time we ll pay you SS.OOfor your help. Please give us 
the names and addresses of two people who will know where to reach you during the next few months. 



Name.: — 1 i^amo^ 

Address Address 



Phone — "Pf^o"® 

Relationship.. Relationship. 



46/ Additional Comments by Youth; 



ATTACH ADDITIONAL SHEET, IF MORE SPACE NEEDED. 



FRir 



i5r 



" _ PARTICffAUT FOLLOW-TO. SURVEY ^ 

Intftrvitvftr Initructlpnt 

Thft Follo%^*Up .Survift7 Is to adainl'stered to fty^ry , Individual who has 
participatsd in the program and avary Individual who tjarved a!s part of t;ha 
Control group for the program. Diffarant forms of the Survey have oeen 
developed Ifior participants .and controls so please be sure that you are 
administering the correct one. 

Follow>-*Up Survey 

Please read the introduction on the cover sheet of the vollow**Up Survey to 
th<r respondent. Then read aloud each of the questions' in the survey* You may 
show the questions to the respondent as yotj read them. Fill in the responses 
as the indlvidui*l answers each question. This instnmient is to be filled in 
by the interviewer only. ^ 

o 

Try to read and explain the material in a relatively informal manner. 
The approach is one of working with the respondent to obtain information that 
is as accurate as possible. 

In the box in the upper right comer of the first page of the survey, 
indicate how many phone calls , home visits or other contacts were needed to 
complete the questionnaire. 



\ 
\ 



\ 




ETS,ID nuaiber*^ Enter this ntimber in the boxes provided. 
The ID numbers for the pretested respondent© are listed 
oh' the rosters, sent to you by ETS. 

Self-explanatory. Fill in as indicated. Notice the 
'^skip" Instruction for Item 10. 

Self -explanatory. Notice, however, that for this item 
' and a number of those that follow, the interviewer is 
required to read the correct tense in relation to the job 
experience items. That is, "do" or "did," "is" or "was," 
"present" or "last" are required when asking job-related 
questions of those who either are working full-time new or 

have worked full-time since leaving the program or since 

r 

program personnel's last contact with the respondent. 

Obtain a brief and simple description from the respondent 
of what constitutes the main business of the company named 
in Item 11. (For example, "a factory where auto parts are 
made"; "a store where clothes are sold.") Difi(regard box at 
etrd^of response line. 

Be as specific as possible in the job title. If the respondent 
does not know the job title, obtain a specific description of 
the job tasks or duties. Disregard box at end of response line. 



Itans 14^23? Self-explanatory. Fill in as indicated. Notice the 
"skip" instruction for Item 19* 

Item 24? After reading the quest ion , .read -all ten options; Check 

only one box^ as directed. 

Items ^25-36: Self-explanatory* Pill^in as indicated. 

Item 37? Notice the "skip" instruction. 

For Item 37a » indicate the specific type of work 
performed on the Job and obtain a job title if possible. 

Items 38-39? Self-explanatory. Fill In as indicated. Notice the 
"skip" Instruction for Item 38. 

Item 40? After reading the question, read the 8 options and check 

all boxes that apply. 

Items 41-43? As indicated in the "Interviewer note," Items 41-43 are only 
for respondents presently employed . Note that the "skip" 
instruction in Item 42 should have appeared in Item 43. 

Item 44? Item 44 is intended only for respondents who are presently 

unemployed * 



V 
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Itett 45: Self-explanatory; Fill in as indicated. Probe for a^ 

job choice when the respondent seems hesitant or uncertain 
about vhat job he or she would look for. ^ Obtain a specific 

0 

.occupation when probing. for a job choice. For example, 
"salesperson" or "stock clerk" rather than "work in a 
store"; "secretary,". Vreceptionist,'' or "bookkeeper" rather 
• ' than "work in an office." Disregard box at end of response- 

lin?. 



Items 46-54: Self-explanatory. Fill in as indicated. Notice the "skip" 
instruction for Item 49. 

! 

Item 55: Self-explanatory. Check as many as apply. 

Item 56: Notice *; "trouble with the police" is defined, as 

"arrested, charged or booked. "_ As noted in the purvey, 
status offenses would include parking tickets or runaway 
and should not be included. 

Item 57: Self-explknatory. ^ • 

Item 58: Copy this information and keep it in your file as a 

reference for a possible 8 month follow-up. Read the 
part about payment for follow-up only if you are sure 
.that your program is doing so. 




IS I 



0 



\ 



-5- ' I 



• Item 59: Intended only iox i?esp^dent8_who ansi&ered' I-tem 11. 

"After reading the item, show the Employer's Rating Form 



to the- respondent a!nd go over -the questions if necessary. 
Stress confidentiality of -the inf prmation .to be obtained. 
If *the respondent answers yes to Item 59, check the Appro- 
priate box and filij in the^name of ihe job supervisor as 
indicated. If the respondent answers no to Item 59, check 

y 

V the appropriate box; and do not attempt to contact the 
employer. , * 

^ / 



Item 60t, \ SolicJ.t any additional comments that the respondent may 
care to make about future job plans, feelings about the 
training program or school, or tl^e survey just .completed. 



Employer's Ratirfj^ Form 

Fill in the ETS ID number of the respondent ^eing rated and the date of the 
Foljow-Up Survey at the top of the f orm» Plaint- the name of the individual on 
the appropriate line in the introduction • The completed form should^ be 
returned to you . Please remember to enclose a stamped, retuniVaddressed 
envelope. ^ 
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Program Follow-up Survey 



• We're trying to find out how people v^o hove been in your training 
program for a wtiiie have been doing since they ieft the prograns-iike 

how things have been working out for you in ganerai; what you think _ 
you've gotten out of being in the program; what you are doing now and , 
what things you wouid iike to do fromnow on; how you feei about jobs: 
and so on. \Ate wouid iike to know your feeiings about these things. We 
pian to use what we find out to make prograrro iike this better for trainees. 

• The answers you give to any questions wiii aii be confidentiai and private. 
Anything we find out from these interviews wouid be reported for a whoie 
group at a time (like a fe\^ hundred) so tl^at no one wiii know your answers. 
However, ail the informot'on requested is important and your response to 

. each question will beappreciated. 

• Let me go over the questions with you. It should take no more than about 
25 minutes. Remember, if you dqo't understand a question, please stop 
me to make sure it's clear. 



ASSESSMENT OF YOUTH ALTERNATIVES PROJECT 




ASSESSMENT OF YOUTH ALTERNATIVES PROJECT 

Follow-up Survey 



NO.OfPHONtCAbs^^ 



coNiAciswro^iPTn)-- 



1. ETSID.NO. 





















i. 























3. NAME OF RESPONDENT . 



2. DATE OF 
1NTEI^/IEW_. 



MPNTK DAY 



YEAR. 



4. HOME ADDRESS. 



NUM8£f?AND STP€ET 



CnYANDSlA^ 
• I 

5. TELEPHONE NUMBER WHERB RESPONDENT CAN BE REACHED 



ZIP CODE 



2 



AREACCOE TOEPHONE NUMBER 

iLim I >• I 



6. ftESPONDENT'S SOCIAL SECURnv NUMBER. 



*7.:SEX. 



.d Mai© D Female 



8. DATE OF BIRTH . 













i 





MONTH 



OAY 



YEAR 



9* Hpw many veeks has it been since you left the program (number of weeks)? 
10. Are you presently y/orklng full-time (30 or more hours per week)? 



WEEKS 



I 



□ Yes. (Go on to question 11) 

□ No. out I have worthed full-time since leading the program. 

(Go on to question 11. but ask about most recent job.) 

□ Mo. I have never worked full-time since leaving the program. 

(Skip to question 36.) 



11. Where do;(did) you 
.(most receratiy) work? 



NAME OF GOMPANYJ_ 



NU(ASER AND STREET OR ROUTE ju- 
CJTY AND STATE , 



TEIEPHONE NUMBER ( 



V 



12. What kind of business is (was)* that? _ 

13. What is (was) your Job tltie?J 



14. How helpful was the progrorn In preparing you for this job? , * . 

□ IV was no help at all. □ It helped a little, now and then. ' □ It was Very helpful In a lot of ways. 



\ 



15. How many hours a week do (did) you usuail*/ work? 

16. How many weeks have you been (were you) on that job? 



HOURS 



WEEKS 



17. How much p^r hour do (did) you earn at that Job? . 
18. . Is (Was) this a temporary CETA Job? 



P£R HR 



DOUARS CENTS 

...... Yes □ No 



19. Is (Was) th& your first Job since you left the program? □ Yes ^ □ No 

(If yes, skip to question 23.) 



20. How many jobs (fult-time and part-time) have you had since leaving the program? 



^1/ Why did you leave your last Job? 

□ I quit. □ I was laid off. □ I was fired. 



21a. What was the main reasdn foe that? (Probe.) 



oes 



22. What was your starting hourly salary 

on your first full-time job after leaving the program? 



23. How long were you out of the programybefore you got your first full-time Job? 



24. Which one of the following sources was most helpful in getting you your first fuli-time job? 
(Checl< only on#.) 

1 □''Program staff 

2 D Friends or people in neightxjrhood 

3 D Newspaper 

4 □ Government (public) employment agency 

5 □ Non-government (private) employment agency 

6 D Family 

7 □ Help wanted sign'" 

8 □ Church or community leaders (e.g.. teachers^ ministers, and so on) 

. 9 □ Other (specify): ; 

0 □ None of the above: I got it on rT\y ov\^. ^ 

y ' 

.25. In how many places did you actuqlly 

fill out an application before you go^^your first full-time job? 



27. Did the program staff refer you to.any of those places 

where you either filled out an application or were interviewed? 



28. Since leaving the program how well have your jobs gone? 
^ □ Much better thar I □ Worse than I 



WEEKS 



PtACES 



1 PLACES 



26. In how many places did you actually get to have an interview before you got your first job? 

□ Yes □ No 



thought I would do 



. expected to do 



□ About what I 

expected I would do 



29 Have you gotten a raise on your present (or last) full-time job □ Yes '-' 

29a. If yes: Number of raises ^ — 



30. Did you get a promotion on that full-time job? . . 



□ Yes □ No 



/ 



V 



I would like to find out ho^ you feel about your most recent full-time job. 
{Refer to job Indicated in'answer to question 11). 



31. What are your jfeellngs about the kind of work you do (did)? 
□ It's great; I like it a lot. □ It's okay. ^ 

32. Hov/s your pa\' for the kind of work you do (did)? 

□ Good pay for the kind D Just about what it 

of job I have.(had) . should be fo\ the job 



n Don't like the work at all. 



D A lot less than the 
job is (was) worth 



33. if you have your way, would you want to wc.1< for this place five years from now? 
□ Definitely not. □ I'm not sure. □ Yes, I'm sure I would. 

34. If you knew then what you know now about this/ob~would you have taken the job? 



D No-notif I knew 
what I know now. 



D I'm not too sure. 

/.,. 



□ Yes, I would take 
the job there again. 



35. When you finish a day's work, do (did) you feel like you did something worthwhile? 



D I almost never teel 
(felt) that way. 



D Spmetimes I feel 
/tfelt) that way. 



D I almost always fee! 
(felt) that way. 



36r. Since you left the program, have ypu' 

received any unemployment compensation payments?-.-rrr. D Yes D No 

36a. If yes, how much per week / ' 

' have you received? ^ $ 



37b., How much per hour did you eoin at that job? 



PERWK. 



37. Since you left the program have you done any part-time work for less than 30 hours 

per week? D Yes □ No 

If no,goonto.question38. ]] 

37a. If yes, what kind of work did you do on your last job? 

(Describe type of job.) 



P6R HR. 



Here are some question^ about educational or training activities you might presently be involved 
with. ^ 

38. Are you now going to school or involved in any other troinfng activity? □ Yes □ No 

(If no. Skip to question 41 .) 

39. Is your education or training program full- or part-time? 

□ Full-time □ Part-time 

40. Which describes your education or training program? (Check all those that apply.) 

1 □ Other CETA training program 

2 □ Regular high school 

3 □ Business/vocational technical/trade high school 

4 □ High school equivalency program (GEO) 

5 □ College 

6 n Business/vocational technical postsecondofy (not high school) 

7 □ Union apprenticeship program 

8 □ O^her (specify): 



I would like to ask you a few questions about your plans for the future. 

[Interviewer note: For those respondents vA\o ore employed, continue with question 41. 

For those respondents who ore unemployedp skip to que :tion 44.] 

FOR THOSE PRiSENTlY EMPLOYED: 

41. What's the highest poy you expect to get on the job you have ,/? $ 

42. What plans do you hove for the next six months? (Check all those appropriate.) 

1 □ Keep working at job/no particular plans 4 □ Go to school full-time 

2 o Look for a better job 5 □ Join the armed forces 

3 □ Go into another trdihing program 6 □ Other (specify)- _ 



(Skip tc question 46.) 



43. What kind of a full-time job would you look for if you were to leave this one? 
Write in job choice 



PLEASE CONTINUE ON NEXT PAGE.. 



FOR THOSE PRESENTLY UNEMPLOYED: 



4^. What plans do you have for the'next six months? (Check all those appropriate.) 



•l-El-Look-fofo job- 



2 □ Go Into another training program 

3 □ Go to school full-time 

4 D Join the armed forces 

5 □ Other 



6 D Nothing special (Probe: How do you spend your day?). 



45. What kind of a full-time job would you look for if you were now. looking for a job? 
Write in job choice: 



46. What is the least hourly pay you would take for that job? $ 



47. How much do you know about what it takes to do that job? 
□ I know a lot about , □ 1 know a few things about 



that kind of job. what the job takes. . 
48. What do you think is the highest hourly pay you could earn for the job? $ 



n 1 don't really know 
much about it. 



PEP HR 



PERKR 



49. Since being In the program, has there been a change in the way you get along with your family? 

□ 1 have no fomiV. (Skip to question 52.) 

□ I get along better with □ 1 get along worse with □ 1 get along with them 



them than i used to. 



them than I used to. 



the same way I always did. 



50. How does your family fee! aboui how you did in the program? 

□ They think I'm doing great. □ They think I'm getting by okay. □ They think I'm doing poorly. 



51. Out of v^at you earn a week, about how much do you give to your family? $ 



P£RWK 



52. How often do you save money from your pay? (Check only one.) 
□ I don't earn any money. 



□ 1 save something 
each week. 

53. Do you buy things on credit? 

□ No. 1 don't use credit. 



□ Sometimes I save, 
sometimes ! don't. 



□ I buy some things 
on credit. 



□ I never save 
any of my pay. 



□ 1 buy most everything 
on credit. 



54. Since you !eft the program have you gone to a public Employment 

Service Office (e.g.. State or government employment service?) □ Yes D No 



54a. If yes. how many times (number of Visits)? . 





55. Which of these.people or agencies have been giving you a hard time lately? 


W 


fChecIc OS mcmv at qddIv.I 






1 □ Supervisor at work 


8 D Lawyers 


? 


2 D People you work with 


9 LJ Credit collection outtits 




3 □ Social worker [Welfare) 


10 □ Storekeepers 


} — 


4 □ Employment agencies 


1 1 □ Somebody In your family 




5 □ Program people (like the counselor) 


12 □ A hospltoi, or people who work In a 




6 G The poltee or the courts 


hospital (like the doctors; the clerks) 




7 □ Neighbors 


13 □ Friends 



14 □ Others (specify): . 



56. Since you've been In fhl» program hove you gotten in at., rrouble with the police; been arrested, 
charged or l^opked? (Do not include status offenses, such as parking tickets or runaway.) 



□ No 

□ Just once 



□ A couple of times 



□ More than a couple of times 



57. How important is it to you to keep out of trouble with the police and the low? 

□ Real important; I go out of □ I usually try to steer clear unless □ Not too important; if I get in 



my way to ovoid trouble. 



I'm pushed real hard. 



trouble I don't qare too much. 



58. \Ate appreciate the help that you've given us. We would like to keep up with how you're doing. We will 
wont to talk with you again in the next few months. At that time we'll pay you $10.00 for your help. Please 
give us the names and addresses of two people who will know where to reach you during the next 
few months. 



Nome. 



Address. 



Phone . 



Relationship, 



Nome 

Addre$s_ 



Phone . 



Relationship. 
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Interviewer Note: Ask this question only of respondents who answered question 11 



59. V\te hope to make future programs better by talking to employers who have hired youth from the program 
you were In. Ws want to ask your present (or former) employer how you are (were) doing on your full-time 
Job. Can we ask these questions? (Show questions for Employer's Rating Form and STRESS CONRDENTIALITY). 

□ Yes □ No 



If yes, obtain job supervisor's name: 



60. Additional Comments by Yoc**i: 



5609902 - LcDP30 - 200253 



1 7U 



ETSinNO. 



Employer's Rating Form 



DATE 



We're ddng a study of young people formeriy enrolled in a government sponsored Youth 
Progrom. We would appreciate your giving a brief assessment of one of your employees (or 
former employees) who was enrolled in one such prc^ram. 

The individual we are interested in is • 

We have Ns (her) permission to ask you for this information. 
Your responses are completely confidential. 



ASSESSMENT OF YOUTH.ALTERNATIVE PROJECT 



I Do you feel that this empioyoe puts in a decent day's work? 
□ Yes^definlteiy D Generally; not always 



□ Definitely not 



2 Does this emptoyee get alono with the ottier workers on the joM 
□ Yes, .definitely D Generally; not always 



□ Definitely not 



a Wouki you promoie this ennptoyee? 

□ Yes, definitely D Maybe; rx)t certain 



□ Definitely not 



4. Wouki you hire this employee again? 

□ Yes, definitely D Maybe; with a few reservations □ Definitely not 

5, Compared to other young people who work here, how would you rank this employee? 

□ Cleoriy better than rTK>st □ About the same as most □ Clearly worse than most 
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CONTROL GROUP. FOLLOW-UP SURVEY 



, This Instrument Is to be filled in by the interviewer, 
NOT the respondent. 

• We* re trying to find out how people have been doing since 
our last Contact — like how things have teen working out 
for you in general; what you are doing now and what things 
you would like to do from now on; how you feel about jobs; 
and so on. We would like to^know your feelings about these 
things. 

• The answers you give to any questions will oil be confidential and private. 
Anything we find out from these interviews would be reported for a vjho\e 
group at a time (like a few hundred) so that no one will know your answers. 
However, pll the information requested is important and your response to 
each (Question wlll be appreciated. 

• Let me go over the questions with you. It should take no more than about 
25 minutes. Remember, if you don't understand a question, please stop 
me to make sure it's ciear. 



ASSESSMENT OF YOUTH ALTERNATIVES PROJECT 
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ASSESSMENT OF YOUTH All Ef^NAllVES PROJECT 

Follow-up Survey 



1. fjsid.no. 



NO OfP(«ON€CAllS , 



HO. Of HOMC VSIIS _ 

NO OF omen 

CONUCtSAntMPtEO. 



2. DATE OF 
INTERVIEW.. 



MONtH 



DAY YCAP 



3. NAME OF RESPONDENT. 



4. HOME ADDRESS. 



Kor.'df R AND SI.'VlcI 



C.rVAf^OSIAtc 

5. TELEPHONE NUMBER WHERE RESPONDENT CAN BE REACHED 



6. RESPONDENT'S SOCIAL SECURITY NUMBER. 



7. SEX ........... .□ Vlale □ Female 



AREA CODE 



8. DATE OF BIRTH . 



2IPCO0E 



tElEPHONE NUMBER 



MONTH DAY 



YEAR 



9. Are you presently working full-time (30 or more hours per week)? 

Q^esk (Go on to question 10.) 

QNo, but I have worked full-time 

within the last three months. 

(Go on to question 10, but ask 
about most recent job. ) 
□ No, and I have not worked full-time 

within the last three months. 

(Skip to question 33) 



10. Whore do (did) you 
(most recenfly) work? 



NAMl Oi COMPANY^ 

NUMBf R AND STWEt OR ROUIE . 
CIIY AND SIAIE. — — 



IFUPHONt NUMfttR( 



11. V\/hat kind of business Is (was) that? . 

12. -What is (was) your job title? 



13. How many hours a week do (did) you usually work? .... 

14. I low mony wt\*ks hdvo voiJ bi;on (woio you) on iUo\ |0l > • 



»iCHH?S 



I n 



PCRHR. 



IS. How much per riour do (did) you eam at that job? ^ i 

OOUARS CENTS 

16 • Is (Was) this a temporary CPfA job? □ Yes □ No 

17. (Was) that the only job you've had In the last 

three months? □ Yes □ No 

(if yes skip to question 21) 

18# How many jobs (full-time and part-time) have you had in 

the last three months? ^ ••JOBS 

19, Why did you leave your last job? 

f 

D 1 quit. □ I was laid off. □ I was fired. 

19 a. \A/hat wos the main reason for that? (Probe,) 1 



20 • whot was your starting hourly salary 

on your first full-time job In the list three months? , $ 



PEAHR. 



21. When did you get that full-time job?, 



MONTH DAY YEAR 



22 . Which one of the following sources was most helpful in getting you that full-time job? 
(Check only one.) 

1 □ School counselor 

2 □ Friends or people in neighborhood 

3 D Newspaper 

4 □ Government (public) employment agency 

5 □ Non-government (private) employnr^nt agency 

6 D Family 

7 O Help wanted sign 

8 □ Church or community leaders (e.g.. teachers, ministers, and so on) 

9 □ Other (specify): ^ 



0 D None of the above: I got it on my own. 

23 • . In how many places did you actually 

fill ouf an application before you got that full-time job? i — I — 1 

*» 

24. In how many places did you actually get to have an interview before you got that full-time job? 
25 • Have you gotten a raise on your present (or last) full-time job ? D Yes D No 

n 

25a. If yes: Number of raises La 

26. Did you get a promotion on that full-time job? D Yes D No 

27. How well have you done on the job during the last three mont:hs? 

□ Much better than I ^ □ Worse than I □ About what I 

thought I would do expected to do X7 * expected I would do 



I would like to find out how you feel about your rrjpst recent full-time job. 

V 

c 

28 . Whol are your f oelings^oboul tho kind of work you do (did)? 

□ Ifs gioot; I like il a lol. □ It's okay. □ Oor^'t like the work ot oil. 

I ■ .1 

29. How's your poy for the kind of work youjdo (did)? 

□ Good poy for the kind CD Just obout whot it □ A lot less thon the 

of job I hove Ihod) ^ - j should be for the job job is (wos).wortt^ 



30. If you hove your woy. would you wont to work for this ploce five years from now? 

□ Definitely not. □ Tm aot-^re. ^ □ Yes. I'm sure I would. 

31 . If you knew then NA'hot you know now obout this job-would you hove token the job? 

□ No-not if I knew □ not too sure. □ Yes. I would toke 

, whot I know now, io^^ there ogoin. 

32. When you finish o doy s work, do (did) you feel like you did something worthwhile? 

- □ I olmost never feel □ Sometimes I feel □ I olmost olwoys feel 

(felt) thot woy. (felt) thot woy. (felt) thot woy. 

33. Have you received any unemployment compensation 

payments during the last three months? □ Yes U No 

33a . If. yes. I^ow mrch per week 



I P€RWK 



If yes. now mi --^n per wock ^ |^ 

hove you received? 

34. Have' you done any part-time work for less than 30 hours 

per week during the last three months? ^ u 

^ r if no, go on to question 35^ 

34a . If yes. whot kind of work did you do on your lost job? | | 



(Describe type of job.) 
34 b . How much per hour did you eorn ot thot job? 



\ 



Here are some questions about educational or training activities you might presently be involved 
with. \ 

\ . ' , _ 

35 # ATo ybu now going to school or involved in any other training activity? D Yes D No 

(If no, skip to question 38 . ) ' 

36 • Isyouf etiucotion or training program full- or port-time? 

□ Full-time □ Part-time 

37 • Which desbribes your education or training program? (Check all those that cpply.) 

1 □ A CETA training program , 

2 □ Regular high school 

3 D Business/vocotiopol. technical/trade high school 

4 □ High school equivalency program (GEO) 

5 □ College \ 

6 U Business/V^^otionol technical postsecondoiy {not high school) 

7 □ Union gpprenticeship program 

a □ Other (specify): ! z 



I would like to ask you a few questions about your plans for the future. 

(Interviewer note): For ttVpse respondents who ore employed, continue with question 38 . 

For thpse respondents who are unemployed, skip to question Al 4 ] 

\ 

FOR THOSE PRESENTLY EMPLOYED: 

\ ^ . 
3S^Whafs the highest pay you expect to get on the job you hove now? S 

39 1 What plans do you hove for the next six months? (Check all those'oppropriate.) 

1 □ Keep working at job/no particular plans ' 4 □ Go to s(phool full-time 

5 D Join the armed forces 

6 □ Other (specify): 



PERHR 



2 o Look for a better job 

3 Qgo into a training program 



40 # Whaj kind of o full-time job would you look for if you were to leave this one? 

Writd in job choice: ^ 

" j (Skip to question 43-) 

I ■ ' : 




PLEASE CONTINUE ;5n NEXT PAGE.. 
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FOR THOSE PRIS8NTLY UNEMPLOViD: 

41. What plans do you have (or the next six months? (Cneck at! those appropriote.) ' 

l' □ Look for a job 1. / 

2 □ Go into another training program ^/ 

3 □ Go to school full-tlmo / 

4 □ Join the armed forces 

5 □ Other. — 



6 □ Ncithing special (Probe: How do vcu spena your dov^). 



42 . What kind of a full-time job would you look for if you were now looking for a job? 
Write in job choice: _ — 

43. What is the least hourly pay you would take for ♦hat job? S 

44 . How much aa you know about what it takes tb do that job? ' 
• □ I knowo lot obou! ■ □ I know a few things about □ I don't really know 

that kind Df job. what the job takes. much about it. 

t ' ' ( 

/ 

45 . What do you think is the highest hourly pay you could earn for the job? $ 

46. Within the fast three months, has there .be^en a change in the way^yau get along 
with iyaur family? / ' . 

□ I have na family. (Skip to question 4 9 ♦ ) / 

□,^,o,o„o»a„e,w,m °rsa°rw:rza». 

them than ! used to. therr. than I usecj ra. 

47. Hawdaes your family feel about how you/ve been doing aver the last three months? 

□ Th-evlthinM-m doing great. □ They tjuok .m gttting by akay. □ Ihey th.nM-mdoing^ooMy. 



40. out of what you earn a week, about haw much do you give ta your family? S L_L 



P£RWK 



49. HOW Often do you save money from your pay? (Check only orve.) 

□ I don't earn any money. ^ 
^ □ I save 'something □ Sometimes I save. 



each week. 

5 0. Da yau.buy things on crodif^ 
□ NQ, I don t use credit. 



sometimes I don't. 



O I buy some things 
on credit. 



□ I never save 
any of my pay. 



□ I buy most everything 
on credit. 



51a. If yes, haw rnony times (number of visits)'> 



1 



52 • \A^ich|^o( fheso people or ogencies hove been giving you a hord time iotely? 
* (Check <3$ many Qib'pply.) 

1 D Supervisor ot work ' 8 D LOvwyers 

2 DTeoployou WofK vsnlh 9 □ Oadit collection outfils 

3 □ Social worker (Welfore) , . * 10 □ Storekeepers 

4^D CrT^pIoymentpoi)ix:i,o$ 11 □ Somebooyinyourfomily ' : 

5 □.School Counselor- * 12 □ Ahospitol. or people whowork in o 

6 □ The pohce or the coum; hospltol (like the doctors: the clerks) 

7 □ Noiglibors -13 □ Friends 

14 □ Others (specify): 



53* Within the last three months, have you gotten in any trouble with the police; 
been arrested, charged or booked? (l^o not include status offenses, such as 
parking tickets or runaway*) 

□ no ■ ' ' . ' 
O Just once ' D A coupje of times D More thon o couple of tirries 

54 « How importont is it to you to keep out of trouble with me police and the low? 

□ i^eol importont; I go out of G t usuolly try to steer clear unless P Not too important; if i get in 
(Tiy way to ovoid trouble. Tm pushed real hard. trouble I don't core tooTnuch. 

55 • oppreciote the help thot youVe given us. W9 would like to keep up with hcy^ you're doing. We will 
wont to talk with you a^oin in the next few months. At thot time well poy you SlO.OO for your help. Pleose 
give us the nomes and oddresses of tv/o people who will know where to reoch you during the next 
lew months. 

^ Nome • 



Address <^ 



Pt-ione 

Relationship 

' Nome 

Address 



Phone 

Relotionship 



/ 



interviewer Note: Ask this question .only of respondents who onswered question 10. 

56. We want to. ask your 'present (or former) employer hovr you are (were) doing 
on your full-time job. Can we ask these questiojis? (Show questions for 
Employer's Rating Form and STRESS CONFIDENTIALITY). 

□ Y0S □ No 



II yes. oDtoin lob supervisoi's noma- 



57 , Additional ComrrWrrtrby Youth: 



f 



l7y 



Employer's Rating Form 



ETSLD.NO. 
DATE 







'4 





















We're doing a study of -young pepple formerly enrolled in o government sponsored Youth 
Program. We would oppieciote your giving o brief assessment of one of your employees (or 

former employees) who was enrolled in or^ such jxogram. ; 

J 

The individual we are interested in is : i 



/ 



We have his (her>'permisslon to ask you for this information. 
Your responses are completely confidential. 



ASSESSMENT OF YOUTH ALTERNATIVE PROJECT 



I Do you feel tho^this employee puts In o decent da/s work? 
□ Yes, definitely □ Genercliv. not always 



n Definitely not 



Z Does this Employee get along with the other workers on the job? 
D Yes, definitely D Generally; not always 



3. Would you promote this employee? 

D YesTSef initely D Maybe; not certain 



n Definitely not 



□ Definitely not-- 



4.; Would you hire this employee again? 
i n >fes, definitely D Maybe; with a few reservations D Definitely not 



6. ' Compared to other young people who woi k here, how would you rank this employee? 

D Clearly worse t^an most 



n Clearly better than most D About the same as most 
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PROJECT AND PROCESS 
INFORMATION 
QOESTIONNAIRE 



1. Demonstration Proj ect Descriptors 



project Titl€ ; 



Name and Type of 
Project Operato"? 

Name; 

TjMge: 



C) CETA^ Prime Sponsor Staff' 

i") Other I#ocal Government Agency or 

^ Onit 

C) Secondary Public School 



Post-Secondary School or Other 
Educational Institution 



O Private "For-Profit" Training 
^ Orgsmization 

Private Nonprofit Community-Based 
^ Organization Offering Predominantly 
Employment and Training Services 

private Nonprofit* Community-Based 
Organization Offering Widis Range of 
Services (e.g., health, housing, 
child care, senior citizens activities, 
etc.) 

(Zl state agency 

(J Federal agency 

(*) Other 



Project Location: 



Initial Funding 
Date ; 

Termination Date 
of Present 

Funding;, 



Termination Date 
of Project: 

Type of Project 
In-Scliool 

In-School & Summer^ 
Summer 

Out-of-S.chool 
Mixed in School 
• Out of School 



181 



Du.we Questionnaire 
Completed 

Title Person 
.Completing 
Questionnaire 
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WuinbT of Planned Payticipants at Peak Point 
NumbT of Flan?tad ^^rtjcipants Currently ^ 



Planned Enrollmen t 
FeriOQ for T^^pxcal 
Completer t 



No. Weeks 

No* Hours Per Week 



'Site 

Characteristics 



The geographical area /CI mile radius) 
surrounding the project location or 
target area nay best be described as: 



Central City Poverty Area 
•Central City Nonpoverty Area 

Suburban Poverty Area 
Suburban Nonpoverty Area 
Rural Poverty Area 



Rural Nonpoverty Area 

The econorcy of the surrounding labor 
market (approximately X hour commute 
by automobile or public transportation* 
may best be classified according to its 
aggregate unemployment rate as follows: 



Excessive Unemployment 10 % or above 

High Unemployment 7 % - 10% 

Moderate Unemployment 5 % - 7% 

Low Unemployment: Below 5% 



Project Cycles 



List dates cohorts of your 
project begin and ended 



Group 

1 

2 

3 

4 

5 

6 

7 

S 
9 

10 . 



Niunber of Youth 



Start Date 



Eiid Date 



2* Project Services Profile 



Program Activities/ 
Services^ 

• 


(1) 

Check mark the 
activities/ser- 
vicj^s provided 
directly by 
your project 

- 


(2) 

pieck mark 
the activ- 
iti ^ser- 
vi pro- 

partici- 
pants in 
your pro J* 
ect through 
arrangements 

agencies 


(3) ^ 
What percent- 
age of total 
nonclerical 
staff time is 
snent in oro- 
viding each 
check marked 

vice in 
column I 

must add to 
100%) 


(4) 

What percent- 1 
aae of par- 
ticipants re- 
ceive services 
or jpartici- 
pates in ac- 
tivities 
check iDa.Tkficl 
in either 
colioin 1 or 
2 


(5) 

^at percentage 
of time does a 
typical program 
completer spend 
Ln each checked 
marked activity/ 
service in 
column 1 (Per- 
centage muse add 
to 100%) 


1. Outreach/Recruit- 
ment of You;:h 












2. Eligibility Cer- 
tification 












3. Testing/assess- 
ment and employ- 
ability plan 
deve lopment 












4, Counseling for 
career or per- 
sonal problems 












5* Other preeaiploy- 
ment services in- 
cluding world-of- 
work or basic 
skills training, 
job application • 
and search assis- 
tance 












6. Vocational explor- 
ation in classrooB 
or in worksite 
visits, job rota- 
tion in training 
capacity in multi- 
ple worksites 






■ ■ 7 







7, Classroom train- 
ing in vocational 
skills 












8. Remedial educa- 
tion, GEO, ESL 






* 


- 




9« On-the-job train- 
ing 












10, Kork experietiCG 












11. Support services 
(transportation , 
medical, child 
care, etc«] 




- 








12. Placement and job 
development 










J 


13. Other In-Program 
activities 




0 








14. Post -program 

assistance (e.g*, 
coaching, coun- 
seling and follow 
up 






Vcrn 




X 



Whlc^ of the following do yru think arc roost critical in achieving 

(" 

f. successful outcome with youth in your program? (Rank them in 

. • 

ordsr from most important to least important, l-7») 



Personal and character development (motivation , self-image 9 
self 'Concept, interpersonal skxii^; appropriate social 
behavior r etc.) • 

Information about jobs and employers (world-of-work orien- 
tati'onr occupational and labor market information, learning 
to search for a job/con^lete employment application and 
interview, etc) • 

Work habits e:.d attituiles (acceptance of supervision/ 
authority, interpersonal relationships in work settings, 
promptness in reporting to and performing iob, etc«l» 

Training for specific job skills (OJT, classroom training, 
job Internships, etc.}. 

Basic educational skills (remedial education, GED. cognitive 
skills, etc.)« 

Brokering placement (connecting youth with placement oppor- 
tunxty - identifying opportunities whether at employers, 
schools or military, arranging interviews for these oppor- 
tunities, getting youth to the placement setting, etp.) • 

Followup support ■T3r\ices after leaving program (job coaching/ 
counseling - ::ontinued contact with youtft and/or employer, 
ichpol personnel, etc.)* 

^ " "'^ 

1 w ' 

JL o "X 



\ 



3. Linkages 

. u^-^ thA ijaportanc* to the various dimensions 

Pie... d^fi^'JVj^i^n iifJo^iiSS arrangements involved in 
pr^fecf tSclS^ in?onnal worki'nc, relationships 

SJitt;n S«ements a. well as contractual relationship. 



CETA Prime Sponaor 



Design and 
Planning 



CETA Private Indus- 
try Council 



Other Iiocal Gov- 
erninent Agency 
or Unit 



Other Federal Gov- 
ernment Agency 
or Unit 



Local Public School- 



Post-Secondary 
School 



Private- for-Pro- 
fit Training 
Institution 



Local Nonprofit 
Commun i ty-Bewied 
Organization 
Offering Employ- 
ment and Training 
Services 



Local Private-Non-* 
Profit Community 
Based Organization 
Offering Wide 

' Range of Services 
Ce.g.r X^iealth., 
housing, child care 



'National Commimity 
Based Organiza- 
tion* 



Local organized 

LaJLnr 



Private Employers 



-^tate Agencies 
or organiza- 
tions 



uu 



Admini- 
stration 



c 
u 

mi 



o 
c 



Recruiting/ 
Outreach 



Id 
u 

0 \ 
a 
g ' 



Service 
Delivery^ 



ill 



Placement 

and 
Follow:ap 




Pl«as« describa at bast possibla the types of linkage and 
coordinadLva^ arrangamants which have at least minor importance to the 
project. Cxeludd linkages judged no is^rtanca in Uie previous table. 

0 



\ 



i 

- 


Design and 

Planning . 


1 Administration 


1 Recruiting/ 
1 Outreach 


Service 
Delivery 


Placement ^ 

and 
Followup 


Financial-Purchase of 


C 

OfJ 

1 U « 
) 3T 

1 -H U 
) UQt 

^ 

u > 

CJ? 
c . 


In-Kinb contribution 

to Pro-lAnt* 


H 
« 

U 

c 
e 

c 

"H 

c 

0 ^ 

z c 

is 


u 

0 

<P c 
« 0 

U •H 

« *l 

Qt « 

Q »H 

Q <0 


W 

0 

0 c 
m a 

T 

C G 
U h 
^ Oi 
9 

Qi > 

1 JQ 

« S 

H « 

u u 
c 


ja G 

U A 

Is 

W > 

n & 
Ut 0 


in-Klnd Contribution 
to Proiecfc 


Formal Nonflnancial 
Aureement 


Cooperative Working 
Relationship 


lu 
Do 
1 ^ 

l« « 

|i3 G 
lu Qt 

|i -a 
Bio a 
lu 0 

1^ 


§^ 
^ « 

JQ G 

«l 
Sa 

h« G 


In-Kind contribution 
to Proiect 


H 
10 

■H 

c 

10 

c 

c 

0 ^ 

z c 

is 


Cooperative Working 
Relationship 


Financial-Purchase of 
Services bv Proiect 


Financial-Contribution 
or Payment to Proiect 


In-Kind Contribution 
to Proiect 


Formal Nonflnancial 
Aoreement 


Cooperative Working 
Relationship 


Financial-Purchase ot 
Services' bv Proiect 


Financial-Contribution 


In-Kind Contribution 
to Proiect 


Formal Nonflnancial 
Aqreement 


Cooperative Working ^ 
Relationship:, y 


/ i 

; . 
' \ 


C£TA Prima Sponsor 




















































CETA Private Indus- 
try Codneil 
























-•^^ 


- 


























> \ 


.Othar Local Gov- 
ammant Agency 

,or unit 














I 
































- 






i ' 

5 

i a 


other Federal Gov- 
ernment Agency^^^ 
or Unit 




















































Local Public School- 




















































Post-Secondary ' 

School 




















































Privata-f 0 r-Pro- 
fit Training 
Institution 








































1 


^ 










Local Nonprofit 
Comroun icy-Based 
Organization 

\ Offering Employ- » 
\ment and Training 
Services 

-^-^ 




t 
















































Local Nonprofit 
Community-Based 

. Organization 
Of f ering^Wide Range 
of Services^ (e.g. , 
health, housing, 
child care, s^i^nior 
cxtxzen activities 
and the lihe) 






















1 






























National Community 
Based Organiza- 
tions 




















































Local Organized 
Labor 




















































Private Employers 




















































Stata Agencies 

or Organiza- 
tions 
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c Full-Tiroe Professional 
Staff (Nonclerical 
Staff Who Work 30 or 
More: Hours Per Week) 



Part-Tine Professional 
Staff (Nonclerical Staff 
Who Work Less Than 30 
Hours Per Week) 



Cha racteristics of Paid 
Staff 



No. funded Positions 
Filled' 



Noi Positions 
Vacant . 



(Percentages Are Re- 
lated to Staff in 
Positions Filled) 



No. Fimded Positions 
Filledi 



No. Positions 
Vacant 



(Percentages Are Re- 
lated to Staff in 
Positions Filled) 



SEX 



Maltt 




RACE 

White 

Non-White 

Hispanic 

CTUCATIoy 

B.A. or Degree 
or more 

M.A., M.S. or Ph.D*. 
Degree 



Attended Similar Program 
as dLXi Enrollee 

Worked as Staff in 
Another Program Which 
Served Youth Similar 
to Tho^e in This 
Program 

Experience in Youth 
Programs 

Less than 1 year 

1-2 Years 

3-4 Years 

5 or More Years 



Employed by the Program 
Operator for 



Less Than 1 Year 

1-2 Years 

3-4 Years 

5 or More Years 

Salary 

Less Than $7,5Q0 
$7,500-$10,000 
$10,000-$12,500 , 
$12,b00-$15,000 
$15, 000-517,500 
$17e500-$20,000 
$20,000-$25,000 
$25,000 Plus 



Activities 

Spend Less Than 25% 
of Their Current Kork 
Week Directly Provid- 
ing Services to Youth 

- Spend between 25 to 50% 

- Spend between 50 to 75% 

- Spend more than 75% 



Volunteer Assistance 

Volunteers assisting 
staff or participants 

Houts Per Week 
Averaged by 
Volunteers 



5. Project Start-^up and Stabilit y 



Start-up. Tiioe 

Nurober of weeks between signing of contract 
for the local project and. first enrollment of 
participants 

Number of weeks between signing of contract and 
filling at least 75 percent of budgeted program 
slots for youth 

Kurober of weeks of operation since reaching 
point where at least 75 percent of slots were 
filled 



Organization Experience 

Experience of 
organi^zation 
operating this 
project wit^ 
eii^ioyzaent^nd 
/ training programs 
exclusively for 
ecohomically 
^'disadvantaged 
youth 14-21 
years old 

. Less, than 1 year 
1-2 years 
3-4 years 
5 or more years 

Project Background 

This project represents 



Experience of 
organization 
operating proj- 
ect with employ- 
ment and training 
programs 



Experience as ^ 

recipient ot 

government (State, 
local or Federal) 
funds 



Modification 



") Continuation of similar project 
funded under other sources 

") significant modification of ser- 
vices under previous youth project 

Change in target grox^ of 
previous .yjouth -project" 

New activity and youth, target group 
"* for program operator 

Modification of program previously 
serving adults? increased emphasis 
on youth 



During the first year of T""i°"U'Ltyper?f"se^!^to2%e^^^^^^ 
modified either in terms of emphasis or types or services 

Has not modified _ 

Has slightly modified 

Has significantly modified 

TO what extent are changes still being made in program design 
and operation? 

No change being made ^ 

slight changes being maae ^ 

Moderate changes being made _; 

Significant changes being made _ 
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• ' ^"rii 



/ 



The program as currently operatjLng is „ ~ 

project already completed ^ ; , * 
/ unlikely to undergo any modification In the Immediate future 
likely to undergo slight modifications 
constantly undergoing moderate changes 
constantly undergoing major changes 



What were reasons for modifications 

No modification^ 
Funding change 

Staff change \ ' 

Performance problems / ' 

External Factors 
Other 

What kind of modifications occurred 
No modifications 

Prpgraiqjpatic " / 

Acbninistr^tive 

Other ' ' 

Continuity 

How many proj«(ct directors have there l5^6;n since the first - 
*enrollinent ' 

1 

2 ZIZI 
3 



4 or mors 



Number full-^ime 
professional staff 
(nonclerical work 
30 or more hours 
per week) 

Number part-time 
pro'fes clonal staff 
(nonclerical staff 
who work less than 
30 hours) 



On-Board 
Now 



At 
Peak 
Staffing 



'Cumulative 

Employed 

Since 

Project 

Inception 



Number 

Individuals who 
Have Worked With 
Project Since 
First Enrollment 



/ 



Enrollnwnt Patt«rn« 
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1978 
January 



Fabrvary 



March 



April 



May 



June 



July 



August 



Sept. 



October 



November 



December 



1979 
January 



Vfebruary 



March 



April 



May 



June ' 



July 



August 



September 



October 



November 



December 



1980 
January 



February 



March 



April 



May 



June 



July . 



August 



September 



>ctober 



Novembers- 



December 



Monthly A^rerage 
Number Partici^ 
pants On' * Board 



Hey Enrollees 

During Month 



Terminations 

During Month 



\ 



/ 



6« Co«t Analysig 



o Total ExpTidit\ir«« to D»f ^ 
C£TA Youth project budget 

CETA Title XI D' or VI Public Service Employment 

workers involved in project 
Ot-^er funds used in^prbject 

Estigated Value of In-Kind Contributions to Date 
From Any Soiirce j j \ 

o Expenditures During Last Calendar Year- 

CETA Youth project budget \ 

Other CETA Title IX D or VI Public Service Employment 
Other funds used in project 

Estilmjfeed Value of In-Kin d Contributions During Last 

^ftaT : 

o Expertditures Per Month At Fall Operating Level 

;m ^ 

CETA Youth project budget 

Other CETA Title II Q or VI Public Service Employment 
Other f^nds used in project 

Estimated Value of In-Kind Contribution Per Month at 
Full Operating Level 3 

/ 

o Estimated Cost Breakdowns During Month of Full Operations 

Administrative and clerical staff rejquired 
for operation of prograLm 

Administrativti and clerical- -staff required 
to handle research and spacial reports 
which ue part of demonstration 

Direct services delivery staJff 

Materials, supplies and equipment , 

' ^Income support for participants 
• Other ' * 

o Estimated Cost Breakdowns Since Shart of Project 

Administrative and clerical sta^ff required ^ - 
for ^operation of program 

Administrative and clerical staff required 
to handle research .and special reports 
which are part of jdemons'tration 

Direct services delivery staff 

Materials, supplies and equipment , 

Income support for participants 

Other / / 
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Appendix 2 
Youth Deroonstxation Projects Utilizing 

the SAS through 
March-iaaO 



"More derailed information on the projects listed in this 
appf=fndix is available in The Knowledge Agend a and Knowledge 
Developmgnt Activities ^ Fiscal 1978-1979 . 
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SAS # 

^iCODR-. PROJECT 
NUMBER SITES 



Appendix 2 
DEMONSTRATION -PROJECTS UTILIZING 
STANDARDIZED ASSESSMENT SYSTEM 
THROUGH MARCH 1980 



NAME OP PROJECT* 



ESTIMATED 

YOUTH 

SERVED 
BY PROJECT 



SAS 
RESEARCH 
AGENT 



i 



In-School 
I-l 

1-2 
1-3 

1-4 
1-5 

1-6 

1-7 
1-8 
1-9 



I-IO 



31 

2 
3 

5 
1 



1 
1 
8 
55 
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Youth Career Development for 
School-to~Work frensition 
Denjonstration Project (YCD) 

Health .Opportunities/Positive 
Entry D^ionstration Project (HOPS) 

Youth Career Development for School- 
to-Work Transition Demonstration 
Project (Puerto Rican Forum) 

PUSH/EXCEL School-to-Work 
Transition Demonstration Project 

New Youth Initiatives in Apprentice- 
ship Demonstration Project (BAT- 
Rockford) 

New Youth Initiatives in Apprentice- 
ship Demonstration Project (BAT- 
Des Moines) 

New Youth Initiatives in Apprentice- 
ship Demonstration Project (BAT-RI) 

Junior Achievement Adaptation 
Demonstration Project 

Jobs for Delaware Graduates 
Demonstration Project (Delaware) 

Exemplary In-School Youth Program 
Demonstration Project (XEMP) 



3400 

120 
300 

250 

150_ 

150 

150 
60 
1497' 
9200 



Educational 
Testing 
Service (ETS) 

ETS 



ETS 



ETS 



ETS 



ETS 



ETS 



ETS 



ETS-JDG 



Youthwork 



1 « 
* X 1-/ 



.SAS 
CODE: 
5 ' - NU>iBER 


* 

PROJECT 

SITES 


' ■ ■' _ -Pale' '2:- 
NAME OF PROJECT* 


YOUTH 
SERVED 
BY PROJECT 


SAS 
RESEARCH 
AGENT 


ESTIMATED 
ENKOLIMENT 


/ 
> 


S ,i Out-of -School 

:; ; ' -0=1 r 


•>* 

Service Mix Alternatives 
Denionstration Project (SMAD) 


324 


ETS 


- 


< 


0-2- 


1 


Corporate Career Demonstration 
Project 


113 


ETS 






0-3 


5 


Public vs. Private Sector Jobs 
Demonstration Project 


1520 


St. Louis 
Univ. 






0-4 


1 


GIANt STEP Youth Development . 


124_ 


ETS 




) 




i 


Demonstration Project 










■ 0-5 


1 


Job Factory Job Search Assistance 
Demonstration Project (Brandeis Univ.) 


600 


Brandeis 
Univ. 






0-6 


1 


The Workshop Job Search Assistance 
Demonstration Project (Brandeis Univ.) 


750 


Brandeis 
Univ. 






0-7 


13 


Rural Youth and Housing Pattnership 
Demonstration Project 


600 


ETS 


• 




■ 0-8 


5_ 


Career Advanceaent Voucher 
Development Project 


500 


Clark, Phipps, 
& Harris 


• 




0-9 


1 


Low-Head Dam Youth Employment 
Demonstration Project (DAM) 


60 

> 


Michigan 
State Univ. 






0-10 


21 


Private Sector Initiatives Demonstra- 
. tion Project (PSI) 


1000 


. CPPV 






0-11 


1 


Alternative Program Strategies for 
High Risk Youth Demonstration 
Project- (VERA) 


1350 


VERA 






0-12 


~~ 2. 


Green Thumb Youth Demonstration Project 


300 


• ETS 






a .3 
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5 


Youth Enterprises Demonstration 
Project (CYE) 


350 


ETS 


197 








r_--— - - r-~:~ -■ — ^ 


•'• ' — 


— ™_ 


rrrrr— 
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CODE: 
;NUbIBER" 



« 

PROJECT 
SITES 



NAME OF PROJECT* 



YOUTH 
SERVED 
BY PROJECT 



, SAS ~ 
RESEARCH 
AGENT 



ESTIMATED 
ENROLLMENT 



0-14 

SiHnmer 
-S-1 



Ventures in Community Improvement 
Demonstration Project (VICI) 



S-2 



S-6 



S-8 



S-9 
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4 
* 9 
8 
1 
8 
20 
5 
7 



— Summer- Career"Exploration~Demonstra=~ 
tion Project (Separate Projects at 
QIC, RTP, and HRDI) 

Summer Career^.EjQ>J^jcati(mJBemor^ 
tion Project (RTP) 

Summer Caraev Exploration Demonstra- 
tion Project (SER) 

Summer Science Student Demonstration 
Project (Federal Energy) 

Theatrical Alcohol Awareness Summer 
Demonstration Project 

Impact Evaluation of Sxmmjer Youth 
Employment Program (ALNA) 

Upward Bound/CETA Summer Demonstra- 
tion Project (Marquette) 

Vocational Education/CETA Summer 
Demonstration Project 

Simmier Career Exploration Demonstra- 
tion Project (HRDI) 



1235 



1872- 



CPPV 



__5JL9_ 
1070 
90 
"26 
1000 
797 
400 
300 



OIC 



-RTP- 



ETS 



Oak Ridge 
Univ. 

Mt. Multnoma- 
.Wash. - CETA 

A.L. Nellum 
Assoc. 

Marquette 
Univ. 

PA Dept. of Ed. 



Ruttenberg', 

Friedman 

Killigan 

Grotchess & Assoc. 
Greenleigh Assoc. 



{ 



SAS 

CODE 

NUMBER 



PROJECT 
SITES 
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NAME OF PROJECT* 



YOUTH 
SERVED 
BY PROJECT 



SAS 
RESEARCH 
AGENT 



ESTIMATED 
ENROLLMENT 



S-10 



-S-ll 3 



Mixed 
M-1 



M-2 



M-3 



M-4 



M-5 



16 



5 
7 



Sunmer Career Exploration Demonstra- 
tion Project (National Urban League) 

Summer Camp Vocational Exploration 
Demonstration Project (NFL-PA) 



-Amerlcan-Campln^rAssocl-atiroir 



Vocational. Exploration Demonstration 
Project (St. Louis NAB VEP) 

Syracuse Assessment Demonstration 
Project 

Assembly Youth Employment Demonstra- 
tion Project (Nat. Assoc. For Southern 
Poor) 

Mixed Income Demonstration Project 



Volunteer Assistance Demonstration 
Project (IBS) 



226 
2134 

-1-35- 
3200 
354 
32 

700 
165 



ETS 



ETS 



Hawkins & 
Assoc. 

St. Louis 
Univ. 

City of 
Syracuse 

ETS 



Mark Battle 
Assoc. 



I3S 



*Descriptive information on these projects are available in The Knowledge-Development Ag enda and Knowledge 
Devel o p ment Activities. Fiscal 1978-1979 published by the OfflHT^f Youth Programs . Miowxedge 
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